-- Logs begin at Thu 2022-09-01 13:05:33 UTC, end at Thu 2022-09-01 14:21:26 UTC. -- Sep 01 13:51:39.888947 dv-cinder-852210-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 13:51:39.896557 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 13:51:39 2022] *** Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: nodename: dv-cinder-852210-7-iscsi Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: machine: x86_64 Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: clock source: unix Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: pcre jit disabled Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: detected number of CPU cores: 4 Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: current working directory: / Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: detected binary path: /usr/bin/uwsgi-core Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: your processes number limit is 47680 Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: your memory page size is 4096 bytes Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: detected max file descriptor number: 2048 Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: lock engine: pthread robust mutexes Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: thunder lock: enabled Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 13:51:39.901853 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 13:51:39.939509 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: Python main interpreter initialized at 0x5644cdba59c0 Sep 01 13:51:39.939509 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: python threads support enabled Sep 01 13:51:39.939509 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: your server socket listen backlog is limited to 100 connections Sep 01 13:51:39.939509 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: your mercy for graceful operations on workers is 90 seconds Sep 01 13:51:39.939905 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 13:51:39.939905 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: *** Operational MODE: preforking *** Sep 01 13:51:39.940184 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: *** uWSGI is running in multiple interpreter mode *** Sep 01 13:51:39.940184 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: spawned uWSGI master process (pid: 112389) Sep 01 13:51:39.940381 dv-cinder-852210-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 13:51:39.940951 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: spawned uWSGI worker 1 (pid: 112390, cores: 1) Sep 01 13:51:39.941287 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: spawned uWSGI worker 2 (pid: 112391, cores: 1) Sep 01 13:51:39.941446 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 13:51:40.597548 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 13:51:40.598420 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 13:51:41.680638 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:51:41.680638 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: from cryptography.utils import int_from_bytes Sep 01 13:51:41.681237 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:51:41.681237 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: from cryptography.utils import int_from_bytes Sep 01 13:51:41.685040 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:51:41.685040 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: from cryptography.utils import int_from_bytes Sep 01 13:51:41.686109 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:51:41.686109 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: from cryptography.utils import int_from_bytes Sep 01 13:51:44.195351 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:51:44.195913 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:51:44.196111 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:51:44.196471 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:51:44.196725 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:51:44.196827 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:51:44.197183 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:51:44.197270 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.197415 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.197509 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:51:44.197729 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.197887 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:51:44.198075 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.198229 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:51:44.198395 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.198503 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.198701 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.198816 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.199014 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.199124 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.199328 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.199436 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.199652 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.199754 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.199909 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.200039 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.200213 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.200394 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.200561 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-7-iscsi {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.201325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.201433 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.201600 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.201725 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.201853 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.202001 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.202168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.202319 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.202462 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-7-iscsi {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.202618 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.202785 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.202935 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.203090 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.203238 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.203397 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.203713 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.203814 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.204021 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.204156 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.204342 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.204463 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.204654 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.204773 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.205059 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.205251 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.205455 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.205651 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.205839 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.206018 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.206198 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.206383 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.206561 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.206757 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.206977 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.207163 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.207356 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.207514 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.207730 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-7-iscsi {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.207916 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.208112 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.208271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.208447 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.208662 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.208856 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.209059 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.209246 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.209448 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-7-iscsi {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.209634 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.209800 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.209965 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.210159 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.210295 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.210425 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.210582 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.210715 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.210848 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.210973 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.211095 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.211249 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.211375 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.211509 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.211648 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.211790 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.211923 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.212048 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.212178 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.212311 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.212447 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.212602 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.212735 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.212858 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.212988 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.213137 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.213262 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.213384 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.213513 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.213637 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.213780 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.213923 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.214049 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.214189 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.214311 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.214432 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.214569 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.214705 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.214829 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.214962 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.215092 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.215092 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.215395 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.215528 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.215659 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.215790 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.215915 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.216037 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.216174 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.216174 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.216423 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.216557 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.216683 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.216852 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.216984 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.217335 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.217467 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.217597 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.217720 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.217874 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.218000 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.218133 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.218258 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.218389 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.218514 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.218644 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.218774 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.218907 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.219030 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.219157 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.219293 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.219418 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.219540 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.219661 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.219782 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.219903 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.220033 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.220162 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.220293 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.220435 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.220558 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.220680 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.220815 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.221049 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.221183 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.221338 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.221469 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.221593 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.221752 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.221922 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.222075 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.222232 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.222378 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.222524 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.222680 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.222840 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.222993 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.223158 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.223326 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.223470 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.223608 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.223732 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.223854 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.224032 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.224159 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.224348 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.224475 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.224676 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.224810 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.224977 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.225103 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.225234 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.225367 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.225497 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.225622 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.225811 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.225954 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.226129 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.226255 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.226430 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.226565 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.226728 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.226864 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.227027 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.227153 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.227490 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.227623 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.227756 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.227879 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.228000 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.228120 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.228241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.228373 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.228496 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.228626 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.228757 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.228879 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.229035 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.229166 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.229335 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.229546 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.229677 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.229863 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.229989 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.230120 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.230243 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.230372 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.230494 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.230615 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.230803 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.230939 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.231104 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.231238 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.231402 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.231528 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.231701 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.231825 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.232027 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.232163 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.232328 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.232454 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.232632 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.232762 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.232930 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.233084 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.233256 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.233389 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.233567 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.233693 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.233884 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.234013 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.234184 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.234318 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.234494 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.234627 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.234794 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.234929 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.235093 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.235221 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.235389 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.235513 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.235686 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.235812 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.235990 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.236124 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.236289 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.236413 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.236581 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.236707 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.236877 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.237006 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.237170 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.237303 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.237622 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.237758 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.237942 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.238056 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.238178 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.238310 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.238434 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.238564 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.238687 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.238816 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.238939 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.239071 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.239236 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.239372 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.239544 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.239671 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.239847 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.239989 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.240150 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.240278 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.240469 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:51:44.240595 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.240805 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.240933 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.241138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.241275 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.241444 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.241575 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.241754 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.241915 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.242096 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.242223 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.242404 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.242531 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.242712 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.242839 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.243019 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.243145 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.243333 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.243475 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.243648 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.243784 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.243961 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.244086 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.244252 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.244389 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.244564 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.244693 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.244873 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.245006 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.245180 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.245315 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.245495 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.245624 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.245836 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.245966 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.246152 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.246290 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.246726 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.246860 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.247036 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.247161 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.247354 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.248154 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.248291 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.248419 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.248543 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.248674 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.248798 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.248931 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.249096 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.249230 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.249401 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.249535 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.249707 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.249868 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.250065 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.250192 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.250376 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.250503 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.250711 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.250838 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.250961 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.251091 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.251270 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.251404 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.251587 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.251713 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.251895 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.252023 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.252202 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.252338 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.252506 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.252633 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.252815 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.252956 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.253121 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.253255 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.253429 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.253555 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.253740 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.253889 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.254076 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.254216 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.254446 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.254570 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.254755 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.254889 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.255071 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.255206 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.255378 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.255505 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.255683 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.255809 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.255988 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.256144 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.256277 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.256400 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.256590 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.256752 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.256883 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.257016 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.257166 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.257293 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.257465 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.257598 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.257865 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.258222 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.258362 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.258488 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.258610 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.258740 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.258873 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.259004 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.259136 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.259273 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.259397 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.259520 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.259655 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.259777 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.259900 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.260029 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.260153 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.260277 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.260449 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.260584 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.260753 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.260888 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.261055 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.261181 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.261360 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.261492 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.261664 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.261816 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.261986 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.262131 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.262295 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.262420 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.262592 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.262740 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.262893 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.263029 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.263252 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.263909 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.264073 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.264201 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.264380 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.264517 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.264686 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.264813 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.264991 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.265116 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.265300 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.265428 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.265607 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.265732 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.265953 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.266075 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.266236 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.266373 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.266546 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.266673 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.266859 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.266984 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.267167 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.267303 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.267476 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.267605 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.267786 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.267910 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.268087 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.268412 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.268541 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.268666 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.268789 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.268921 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.269052 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.269176 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.269308 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.269439 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.269564 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.269696 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.269838 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.269975 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.270114 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.270238 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.270417 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.270553 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.270716 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.270844 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.271014 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.271156 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.271332 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.271469 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.271637 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.271766 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.271937 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.272071 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.272238 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.272364 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.272533 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.272667 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.272856 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.272981 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.273156 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.273277 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.273480 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.273604 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.273760 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.273917 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.274085 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.274200 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.274427 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.274541 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.274731 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.274844 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.275040 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.275153 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.275348 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.275468 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.275655 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.275781 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.278095 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.278261 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.278608 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.278789 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.278933 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.279073 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.279218 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.279351 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.279476 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.279598 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.279722 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.279853 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.279978 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.280108 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.280234 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.280357 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.280479 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.280611 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.280743 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.280871 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.281003 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.281127 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.281127 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.281440 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.281566 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.281689 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.281844 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.281969 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.282105 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.282240 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.282372 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.282497 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.282497 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.282727 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.282858 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.282982 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.283104 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.283226 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.283357 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.283480 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.283615 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.283740 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.283869 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.283992 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.284128 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.284262 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.284400 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.284523 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.284646 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.284776 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.284899 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.285021 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.285153 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.285276 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.285400 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.285522 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.285644 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.285790 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.285917 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.286039 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.286162 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.286283 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.286407 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.286548 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.286674 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.286796 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.286919 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.287048 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.287173 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.287308 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.287432 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.287556 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.287678 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.287799 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.287929 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.288061 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.288185 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.288307 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.288430 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.288744 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.288883 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.289009 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.289132 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.289254 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.289377 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.289499 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.289632 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.289757 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.289941 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.290068 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.290191 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.290312 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.290444 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.290569 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.290700 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.290823 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.290950 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.291072 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.291208 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.291340 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.291464 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.291586 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.291720 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.291858 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.291990 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.292113 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.292236 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.292357 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.292478 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.292613 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.292747 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.292879 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.293010 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.293134 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.293256 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.293387 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.293510 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.293632 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.293756 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.293905 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.294031 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.294162 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.294309 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.294436 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.294559 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.294689 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.294823 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.294948 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.295071 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.295223 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.295351 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.295524 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.295664 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.295854 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.295980 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.296170 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.296295 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.296443 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.296581 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.296760 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.296889 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.297070 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.297205 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.297374 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.297509 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.297677 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.297853 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.297993 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.298118 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.298296 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.298433 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.298789 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.298927 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.298927 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.299162 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.299300 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.299434 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.299595 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.299717 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.299840 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.299961 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.300093 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.300216 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.300362 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.300488 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.300674 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.300808 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.300988 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.301242 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.301382 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.301571 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.301707 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.301905 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.302035 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.302214 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.302340 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.302531 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.302660 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.302846 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.303107 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.303247 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.303446 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.303565 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.303765 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.303893 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.304064 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.304198 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.304369 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.304496 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.304668 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.304806 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.304981 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.305115 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.305261 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.305389 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.305560 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.305687 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.305882 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.306025 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.306183 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.306319 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.306493 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.306621 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.306792 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.306928 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.307090 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.307208 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.307387 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.307501 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.307687 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.307810 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.307995 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.308115 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.308296 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.308408 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.308601 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.308714 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.309041 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.309155 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.309261 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.309372 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.309487 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.309592 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.309807 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.310442 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.310615 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.310802 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.310927 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.311124 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.311237 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.311430 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.311543 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.311755 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.311878 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.312066 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.312181 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.312852 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.312984 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.313118 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.313246 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.313377 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.313500 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.313630 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.313763 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.313909 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.314045 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.314170 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.314300 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.314300 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.314542 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.314673 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.314798 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.314920 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.315042 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.315163 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.315294 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.315418 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.315540 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.315661 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.315784 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.315950 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.316085 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.316253 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.316380 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.316549 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.316676 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.316857 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.316985 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.317155 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.317281 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.317460 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.317586 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.317762 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.317936 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.318070 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.318195 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.318359 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.318485 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.318660 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.318788 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.319111 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.319249 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.319375 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.319508 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.319633 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.319763 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.319887 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.320001 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.320123 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.320254 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.320378 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.320502 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.320676 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.320804 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.320975 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.321117 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.321278 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.321413 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.321579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.321705 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.321900 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.322046 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.322213 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.322340 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.322514 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.322640 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.322813 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.322943 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.323112 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.323239 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.323412 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.323545 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.323709 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.323848 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.324005 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.324134 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.324309 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.324444 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.324619 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.324746 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.324923 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.325052 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.325219 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.325346 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.325541 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.326234 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.326384 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.326526 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.326687 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.326825 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.326995 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.327123 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.327297 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.327431 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.327596 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.327732 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.327896 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.328023 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.328192 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.328327 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.328490 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.328632 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.328788 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.328917 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.329244 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.329379 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.329513 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.329647 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.329791 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.329916 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.330050 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.330182 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.330320 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.330442 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.330565 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.330685 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.330846 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.330981 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.331153 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.331286 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.331463 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.331590 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.331766 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.331901 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.332071 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.332199 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.332372 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.332498 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.332675 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.332806 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.332981 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.333109 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.333279 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.333412 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.333587 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.333714 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.333900 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.334026 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.334207 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.334333 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.334504 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.334644 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.334801 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.334927 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.335118 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.335252 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.335422 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.335558 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.335726 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.335854 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.336041 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.336167 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.336359 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.336494 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.336678 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.336806 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.336976 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.337100 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.337278 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.337411 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.337585 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.337710 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.337910 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.338037 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.338242 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.338369 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.338492 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.338621 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.338795 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.338930 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.339289 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.339430 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.339554 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.339679 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.339803 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.339937 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.340071 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.340196 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.340327 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.340452 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.340576 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.340707 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.340841 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.340968 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.341142 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.341281 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.341466 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.341603 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.341809 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.341943 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.342090 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.342218 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.342395 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.342534 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.342693 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.342820 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.342998 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.343125 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.343292 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.343427 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.343617 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.343751 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.343926 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.344054 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.344228 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.344364 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.344537 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.344664 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.344841 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.344976 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.345182 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.345312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.345445 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.345570 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.345749 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.345906 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.346072 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.346210 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.346462 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.346604 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.346765 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.346901 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.347073 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.347209 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.347375 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.347501 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.347673 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.347810 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.347972 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.348100 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.348271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.348397 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.348583 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.348718 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.348882 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.349017 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.349180 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.349509 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.349627 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.349759 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.349950 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.350077 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.350201 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.350320 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.350445 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.350577 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.350775 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.350903 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.351079 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.351206 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.351379 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.351517 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.351745 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.351879 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.352064 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.352192 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.352366 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.352505 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.352680 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.352814 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.352997 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.353125 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.353315 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.353444 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.353617 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.353754 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.354070 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.354203 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.354376 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.354505 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.354693 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.354823 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.355009 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.355137 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.355311 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.355438 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.355636 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.355764 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.355888 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.356011 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.356207 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.356335 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.356512 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.356643 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.356842 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.356972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.357161 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.357297 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.357463 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.357590 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.357812 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.357957 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.358084 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.358216 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.358406 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.358535 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.358728 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.358857 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.359038 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.359175 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.359567 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.359708 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.359708 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.359927 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.360040 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.360174 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.360300 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.360414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.360536 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.360683 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.360819 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.361008 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.361136 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.361312 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.361447 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.361616 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.361755 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.361953 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.362099 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.362260 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.362388 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.362565 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.362702 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.362860 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.362987 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.363176 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.363303 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.363484 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.363620 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.363781 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.363905 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.364070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.364206 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.364374 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.364503 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.364676 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.364833 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.364982 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.365108 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.365283 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.365412 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.365581 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.365716 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.365923 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.366050 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.366228 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.366357 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.366529 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.366655 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.366839 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.366965 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.367161 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.367291 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.367472 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.367601 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.367772 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.367909 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.368073 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.368202 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.368378 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.368506 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.368700 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.368835 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.369012 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.369145 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.369328 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.369454 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.369791 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.369937 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.370065 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.370189 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.370322 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.370445 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.370567 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.370704 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.370830 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.370953 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.371075 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.371214 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.371614 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.371795 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.371923 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.372120 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.372249 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.372932 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.373074 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.373240 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.373368 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.373548 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.373676 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.373880 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.374025 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.374185 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.374311 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.374474 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.374604 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.374771 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.374906 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.375070 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.375198 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.375368 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.375494 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.375670 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.375807 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.375991 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.376120 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.376292 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.376419 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.376608 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.376744 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.376915 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.377040 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.377213 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.377347 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.377517 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.377659 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.377840 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.377969 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.378152 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.378279 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.378461 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.378591 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.378770 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.378901 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.379073 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.379211 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.379382 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.379519 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.379844 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.379977 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.380103 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.380236 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.380362 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.380510 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.380639 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.380835 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.380971 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.381148 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.381276 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.381459 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.381599 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.381808 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.381951 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.382087 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.382212 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.382390 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.382518 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.382700 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.382845 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.383009 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.383229 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.383359 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.383555 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.383690 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.383877 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.384015 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.384216 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.384358 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.384490 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.384616 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.384815 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.384951 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.385085 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.385217 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.385389 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.385530 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.385700 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.385859 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.386037 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.386174 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.386349 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.386486 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.386674 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.386803 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.386975 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.387104 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.387292 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.387420 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.387603 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.387731 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.387912 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.388082 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.388770 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.388908 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.389088 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.389218 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.389403 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.389530 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.389712 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.389907 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.390100 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.390229 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.390368 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.390503 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.390628 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.390740 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.390922 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.391050 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.391242 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.391379 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.391560 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.391694 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.391871 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.391998 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.392176 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.392311 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.392485 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.392612 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.392794 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.392921 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.393104 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.393305 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.393419 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.393618 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.393753 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.393970 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.394111 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.394295 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.394432 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.394614 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.394716 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.394925 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.395039 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.395236 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.395334 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.395559 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.395670 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.395859 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.396073 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.396176 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.396390 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.396490 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.396752 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.396865 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.397024 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.397121 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.397346 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.397441 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.397651 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.397761 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.397973 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.398080 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.398287 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.398373 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.398590 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.398685 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.398896 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.399113 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.399200 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.399462 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.399556 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.399778 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.399873 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.400099 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.400193 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.400406 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.400511 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.400719 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.400823 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.401014 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.401120 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.401328 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.401439 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.401626 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.401880 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.401985 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.402233 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.402319 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.402540 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.402626 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.402843 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.402930 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.403144 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.403244 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.403453 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.403538 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.403784 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.403870 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.404084 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.404183 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.404389 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.404477 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.404687 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.404776 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.405003 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.405106 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.405300 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.405386 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.405599 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.405686 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.405917 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.406019 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.406223 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.406309 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.406520 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.406605 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.406818 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.406905 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.407118 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.407204 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.407416 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.407499 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.407717 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.407803 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.408015 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.408102 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.408315 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.408399 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.408611 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.408696 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.408915 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.408999 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.409212 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.409309 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.409511 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.409597 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.409838 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.409928 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.410147 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.410409 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.410564 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.410706 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.410845 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.410982 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.411129 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.411277 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.411426 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.411582 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.411725 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.411863 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.412000 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.412147 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.412288 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.412425 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.412564 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.412707 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.412854 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.413005 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.413153 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.413340 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.413499 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.413670 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.413931 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.414081 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.414219 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.414367 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.414532 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.414672 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.414820 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.414967 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.415107 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.415245 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.415398 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.415538 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.415689 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.415829 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.416063 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.416211 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.416396 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.416544 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.416693 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.416838 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.416984 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.417123 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.417268 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.417430 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.417578 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.417718 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.417889 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.418041 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.418181 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.418329 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.418469 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.418608 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.418746 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.418885 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.419023 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.419180 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.419379 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.419533 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.419675 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.419814 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.419961 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.420101 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.420267 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.420423 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.420633 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.420789 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.420939 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.421078 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.421228 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.421366 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.421505 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.421643 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.421821 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.421978 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.422119 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.422265 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.422405 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.422553 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.422713 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.422854 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.423010 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.423156 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.423314 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.423463 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.423602 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.423743 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.423882 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.424020 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.424158 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.424309 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.424527 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.424680 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.424832 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.424977 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.425125 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.425270 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.425410 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.425548 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.425710 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.425883 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.426035 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.426175 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.426354 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.426498 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.426648 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.426808 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.426968 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.427108 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.427246 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.427383 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.427567 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.427722 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.427901 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.428048 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.428225 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.428370 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.428546 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.428721 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.428862 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.429001 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.429141 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.429287 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.429428 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.429575 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.429715 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.429909 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.430041 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.430140 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.430349 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.430508 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.430687 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.430897 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.431042 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.431182 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.431330 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.431469 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.431608 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.431747 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.431885 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.432024 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.432173 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.432323 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.432474 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.432622 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.432762 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.432901 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.433048 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.433188 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.433329 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.433467 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.433606 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.433753 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.433965 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.434106 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.434245 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.434403 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.434551 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.434705 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.434844 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.435493 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.435641 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.435781 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.435919 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.436067 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.436207 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.436346 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.436485 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.436631 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.436780 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.436928 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.437067 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.437213 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.437363 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.437512 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.437660 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.437817 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.437972 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.438113 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.438286 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.438438 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.438588 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.438746 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.438893 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.439032 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.439178 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.439317 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.439464 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.439611 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.439750 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.439888 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.440034 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.440173 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.440321 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.440500 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.440642 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.440780 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.440943 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.441162 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.441306 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.441446 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.441584 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.441731 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.441914 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.441914 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.442262 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.442410 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.442558 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.442706 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.442855 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.443004 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.443145 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.443284 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.443421 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.443559 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.443706 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.443846 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.443985 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.444123 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.444271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.444409 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.444560 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.444699 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.444838 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.444977 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.445115 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.445252 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.445442 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.445590 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.445729 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.445890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.446030 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.446178 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.446328 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.446468 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.446606 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.446745 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.446886 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.447037 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.447177 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.447315 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.447460 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.447599 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.447737 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.447894 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.448034 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.448171 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.448308 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.448447 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.448584 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.448731 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.448870 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.449053 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.449200 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.449393 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.449547 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.449697 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.449877 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.450014 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.450125 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.450329 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.450432 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.451181 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.451337 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.451520 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.451684 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.451827 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.451981 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.452145 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.452310 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:51:44.452461 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.452781 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.453127 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.453440 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.453800 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.454133 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.454454 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.454767 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.455073 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:51:44.455316 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:51:44.604843 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO dbcounter [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Registered counter for database nova_api Sep 01 13:51:44.609221 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO dbcounter [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] Registered counter for database nova_api Sep 01 13:51:44.626902 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_db.sqlalchemy.engines [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:51:44.629535 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:51:44.633607 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writer thread running {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:51:44.635989 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG dbcounter [-] [112391] Writer thread running {{(pid=112391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:51:44.690201 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.context [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8be996a3-c3dc-448b-9d29-95d2c5ed6464(cell1) {{(pid=112390) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 13:51:44.693282 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.context [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8be996a3-c3dc-448b-9d29-95d2c5ed6464(cell1) {{(pid=112391) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 13:51:44.694067 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:51:44.694540 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:51:44.696166 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:51:44.696832 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:51:44.697123 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG oslo_concurrency.lockutils [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:51:44.697273 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:51:44.697602 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG oslo_concurrency.lockutils [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:51:44.699235 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG oslo_concurrency.lockutils [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:51:44.699344 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:51:44.700220 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG oslo_concurrency.lockutils [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:51:44.701216 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG oslo_concurrency.lockutils [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:51:44.701762 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO dbcounter [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Registered counter for database nova_cell0 Sep 01 13:51:44.703253 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG oslo_concurrency.lockutils [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:51:44.705311 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO dbcounter [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] Registered counter for database nova_cell0 Sep 01 13:51:44.705725 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO dbcounter [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Registered counter for database nova_cell1 Sep 01 13:51:44.709350 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO dbcounter [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] Registered counter for database nova_cell1 Sep 01 13:51:44.714577 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_db.sqlalchemy.engines [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:51:44.715345 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_db.sqlalchemy.engines [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:51:44.718789 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:51:44.719604 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:51:44.723707 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writer thread running {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:51:44.724046 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writer thread running {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:51:44.726066 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG dbcounter [-] [112391] Writer thread running {{(pid=112391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:51:44.728718 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG dbcounter [-] [112391] Writer thread running {{(pid=112391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:51:44.870078 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO dbcounter [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Registered counter for database nova_cell0 Sep 01 13:51:44.876105 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO dbcounter [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] Registered counter for database nova_cell0 Sep 01 13:51:44.879418 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_db.sqlalchemy.engines [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:51:44.884279 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writer thread running {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:51:44.884865 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:51:44.890016 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG dbcounter [-] [112391] Writer thread running {{(pid=112391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:51:45.289376 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: WARNING keystonemiddleware.auth_token [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:51:45.296853 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: WARNING keystonemiddleware.auth_token [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:51:45.346399 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: WARNING keystonemiddleware.auth_token [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:51:45.353711 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: WARNING keystonemiddleware.auth_token [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:51:45.641438 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: WARNING keystonemiddleware.auth_token [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:51:45.647775 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: WARNING keystonemiddleware.auth_token [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:51:45.653134 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5644cdba59c0 pid: 112390 (default app) Sep 01 13:51:45.655236 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:51:45.656499 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001784 Sep 01 13:51:45.656899 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Thu Sep 1 13:51:45 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:51:45.693536 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: WARNING keystonemiddleware.auth_token [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:51:45.699522 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: WARNING keystonemiddleware.auth_token [None req-5fa0d623-774f-4919-8035-ac18ac4ea628 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:51:45.704773 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5644cdba59c0 pid: 112391 (default app) Sep 01 13:53:07.501526 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:07.502672 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Sep 01 13:53:07.503148 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:53:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:53:07.515681 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG dbcounter [-] [112391] Writing DB stats nova_api:SELECT=3 {{(pid=112391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:53:07.517097 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG dbcounter [-] [112391] Writing DB stats nova_cell0:SELECT=3 {{(pid=112391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:53:07.518132 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG dbcounter [-] [112391] Writing DB stats nova_cell1:SELECT=3 {{(pid=112391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:53:07.519469 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG dbcounter [-] [112391] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:53:08.586362 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-eeedefd9-c762-42bc-bd35-c27d2ea27c39 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:08.619283 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-eeedefd9-c762-42bc-bd35-c27d2ea27c39 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.109316 Sep 01 13:53:08.621883 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1292 bytes} [Thu Sep 1 13:53:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:53:11.004384 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:11.005469 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-90f277ff-48cd-41b5-972b-6204fa060fe9 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001595 Sep 01 13:53:11.006138 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:53:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:53:11.473646 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-6c67d9e1-6dde-4158-bfc8-96425c80f8b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:11.593148 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-6c67d9e1-6dde-4158-bfc8-96425c80f8b5 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.580688 Sep 01 13:53:11.593987 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 1 13:53:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:53:11.607771 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writing DB stats nova_api:SELECT=3 {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:53:11.608615 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writing DB stats nova_cell0:SELECT=3 {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:53:11.609784 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writing DB stats nova_cell1:SELECT=3 {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:53:11.610759 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:53:11.817231 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-f4760f05-b704-44c2-b88b-c08846f2c84a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:11.938163 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-f4760f05-b704-44c2-b88b-c08846f2c84a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.335767 Sep 01 13:53:11.938766 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1336 bytes} [Thu Sep 1 13:53:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:53:14.306040 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-6c67d9e1-6dde-4158-bfc8-96425c80f8b5 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:14.307612 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-6c67d9e1-6dde-4158-bfc8-96425c80f8b5 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Sep 01 13:53:14.308575 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:53:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:53:14.989276 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-07e326f1-d734-468a-bfc8-24fa7cce0653 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:15.163953 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-07e326f1-d734-468a-bfc8-24fa7cce0653 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.848377 Sep 01 13:53:15.165120 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 1 13:53:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:53:15.177166 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-4bdf6a65-ed32-43e1-b3d8-bdd17f93ee05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:15.323863 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-4bdf6a65-ed32-43e1-b3d8-bdd17f93ee05 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.150339 Sep 01 13:53:15.329927 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1336 bytes} [Thu Sep 1 13:53:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:53:17.716936 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-07e326f1-d734-468a-bfc8-24fa7cce0653 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:17.717996 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-07e326f1-d734-468a-bfc8-24fa7cce0653 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 01 13:53:17.718416 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:53:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:53:18.147483 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-0de8c248-5247-47ea-836b-a9c5de7dc9ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G", "vcpus": 1, "disk": 10, "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:18.242301 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-0de8c248-5247-47ea-836b-a9c5de7dc9ac admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.517514 Sep 01 13:53:18.242910 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 1 13:53:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:53:18.256092 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-266878c9-ef65-4ee4-9afd-efd59f620a04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:18.351357 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-266878c9-ef65-4ee4-9afd-efd59f620a04 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098950 Sep 01 13:53:18.351977 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1336 bytes} [Thu Sep 1 13:53:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:53:20.792666 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-0de8c248-5247-47ea-836b-a9c5de7dc9ac admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:20.794321 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-0de8c248-5247-47ea-836b-a9c5de7dc9ac admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002158 Sep 01 13:53:20.794729 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:53:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:53:21.232173 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-834c13d4-09de-4859-968c-c34054bd44f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:21.331017 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-834c13d4-09de-4859-968c-c34054bd44f0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529884 Sep 01 13:53:21.331709 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 1 13:53:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:53:21.344083 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-609c058c-effb-4ea9-9c31-c09d8de5e14e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:21.430941 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-609c058c-effb-4ea9-9c31-c09d8de5e14e admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090459 Sep 01 13:53:21.431546 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1336 bytes} [Thu Sep 1 13:53:21 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:53:23.899971 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-834c13d4-09de-4859-968c-c34054bd44f0 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:23.902296 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-834c13d4-09de-4859-968c-c34054bd44f0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002746 Sep 01 13:53:23.902871 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:53:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:53:24.347020 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-e6faab50-07f3-4f08-93da-2add6b7d4ed9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "disk": 20, "vcpus": 4}} {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:24.430164 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-e6faab50-07f3-4f08-93da-2add6b7d4ed9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519789 Sep 01 13:53:24.441118 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 1 13:53:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:53:24.444852 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-1d1c5ac9-0b56-431c-8b73-17b07cad5d40 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:24.533675 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-1d1c5ac9-0b56-431c-8b73-17b07cad5d40 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092673 Sep 01 13:53:24.534293 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1336 bytes} [Thu Sep 1 13:53:24 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:53:27.184748 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-e6faab50-07f3-4f08-93da-2add6b7d4ed9 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:27.185659 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-e6faab50-07f3-4f08-93da-2add6b7d4ed9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Sep 01 13:53:27.186060 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:53:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:53:27.653290 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-4c8c010d-94ab-4b2a-93c5-f79c13e3f5ed admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:27.687004 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-4c8c010d-94ab-4b2a-93c5-f79c13e3f5ed admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.494325 Sep 01 13:53:27.688074 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1292 bytes} [Thu Sep 1 13:53:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:53:30.194374 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-e6faab50-07f3-4f08-93da-2add6b7d4ed9 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:30.195386 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-e6faab50-07f3-4f08-93da-2add6b7d4ed9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 01 13:53:30.195795 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:53:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:53:30.646786 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-2b77b06b-a5ef-4b31-a0ee-eda4769840ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny"}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:30.776089 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-2b77b06b-a5ef-4b31-a0ee-eda4769840ad admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.573714 Sep 01 13:53:30.776780 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 1 13:53:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:53:30.788815 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-887a2192-2cfe-448a-b57a-402be0178652 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:30.872665 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-887a2192-2cfe-448a-b57a-402be0178652 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087528 Sep 01 13:53:30.873283 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1333 bytes} [Thu Sep 1 13:53:30 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:53:33.300261 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-2b77b06b-a5ef-4b31-a0ee-eda4769840ad admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:33.301377 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-2b77b06b-a5ef-4b31-a0ee-eda4769840ad admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Sep 01 13:53:33.305281 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:53:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:53:33.705763 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-c6230a88-0055-4bfe-9cde-533736128a0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "disk": 20, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:33.785633 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-c6230a88-0055-4bfe-9cde-533736128a0d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472525 Sep 01 13:53:33.786250 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 1 13:53:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:53:33.799665 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-c7ddbc5a-0b0c-49ce-a200-2d8e5cb23945 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:33.906985 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-c7ddbc5a-0b0c-49ce-a200-2d8e5cb23945 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111147 Sep 01 13:53:33.907716 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1333 bytes} [Thu Sep 1 13:53:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:53:36.380985 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-c6230a88-0055-4bfe-9cde-533736128a0d admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:36.382039 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-c6230a88-0055-4bfe-9cde-533736128a0d admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 01 13:53:36.382621 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:53:36.848427 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-04325dae-42b2-4a6b-b338-9c9ada2a40c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium"}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:36.927897 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-04325dae-42b2-4a6b-b338-9c9ada2a40c2 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.538209 Sep 01 13:53:36.936309 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 1 13:53:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:53:36.942511 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-ed1762c3-c02f-4f36-a257-74112e1fb664 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:37.023657 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-ed1762c3-c02f-4f36-a257-74112e1fb664 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085097 Sep 01 13:53:37.024405 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1333 bytes} [Thu Sep 1 13:53:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:53:39.498121 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-04325dae-42b2-4a6b-b338-9c9ada2a40c2 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:39.499122 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-04325dae-42b2-4a6b-b338-9c9ada2a40c2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 01 13:53:39.499519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:53:39.965720 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-88551ccb-dfb3-4d23-96d3-272b93929d76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0, "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:39.973642 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG dbcounter [-] [112391] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:53:40.142017 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-88551ccb-dfb3-4d23-96d3-272b93929d76 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.628250 Sep 01 13:53:40.143089 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 1 13:53:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:53:40.156148 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-01d842e0-2543-4823-9b32-e3f8412981cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:40.270290 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-01d842e0-2543-4823-9b32-e3f8412981cb admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118009 Sep 01 13:53:40.286000 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1333 bytes} [Thu Sep 1 13:53:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:53:42.700319 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-88551ccb-dfb3-4d23-96d3-272b93929d76 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:53:42.701347 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-88551ccb-dfb3-4d23-96d3-272b93929d76 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 01 13:53:42.701754 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:53:43.152933 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-d63f8791-93fa-494f-a701-52f06b749820 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "swap": 0, "ram": 16384, "vcpus": 8, "disk": 160, "id": "5", "rxtx_factor": 1.0}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:43.289045 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-d63f8791-93fa-494f-a701-52f06b749820 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.580894 Sep 01 13:53:43.289521 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1283 bytes} [Thu Sep 1 13:53:42 2022] POST /compute/v2.1/flavors => generated 408 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:53:43.303400 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-562c37be-0eb3-431d-9264-74558de155dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:53:43.458007 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-562c37be-0eb3-431d-9264-74558de155dc admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.159072 Sep 01 13:53:43.458702 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1333 bytes} [Thu Sep 1 13:53:43 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 13:54:01.481278 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-d63f8791-93fa-494f-a701-52f06b749820 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:01.482385 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-d63f8791-93fa-494f-a701-52f06b749820 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Sep 01 13:54:01.482784 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:54:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:01.881232 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-a63f6e62-eb06-43d4-902e-13fb541b1513 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:01.901822 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-a63f6e62-eb06-43d4-902e-13fb541b1513 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.412348 Sep 01 13:54:01.902284 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1292 bytes} [Thu Sep 1 13:54:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:54:02.971523 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-d63f8791-93fa-494f-a701-52f06b749820 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:02.972528 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-d63f8791-93fa-494f-a701-52f06b749820 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Sep 01 13:54:02.972920 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 1 13:54:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:03.515526 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-672034d3-a197-4fe7-90c3-a54449c1a1e2 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:03.522105 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.wsgi [None req-672034d3-a197-4fe7-90c3-a54449c1a1e2 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-672034d3-a197-4fe7-90c3-a54449c1a1e2 admin admin] Request method failure captured: Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Accept: application/json Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Accept-Encoding: gzip, deflate Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Connection: keep-alive Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Content-Length: 0 Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Host: 10.222.0.61 Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Openstack-Api-Version: compute 2.90 Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Openstack-System-Scope: None Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: User-Agent: python-novaclient Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Auth-Token: gAAAAABjELl66RlIuIcflM0LMXMIsM9lI7eHGcfzqs_KayrqJ45HIX0_VVlqdvM1X5NHBARB8pDWEHjCgOMXmEut24B78XP8FPiOeB329DiaSiAg_4IJdmregwVufrpIVkgw7F5Ekxdf2L8c0fjaX0V4UusRSREpJZAERK9r44nex-0OuF12ahI Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Domain-Id: None Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Domain-Name: None Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Identity-Status: Confirmed Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Is-Admin-Project: True Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Project-Domain-Id: default Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Project-Domain-Name: Default Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Project-Id: 17c0369ad3194a3b8c268accfe2208d0 Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Project-Name: admin Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Role: admin,member,reader Sep 01 13:54:03.525414 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Roles: admin,member,reader Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_17c0369ad3194a3b8c268accfe2208d0"}]}] Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Tenant: admin Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Tenant-Id: 17c0369ad3194a3b8c268accfe2208d0 Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Tenant-Name: admin Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User: admin Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User-Domain-Id: default Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User-Domain-Name: Default Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User-Id: 2afeb1cf31eb47f9a0c823030df9f4cb Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User-Name: admin Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: method: > Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: exception: Flavor 42 could not be found. Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: action_args: {'id': '42'} Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:54:03.526999 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:03.527972 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:03.529168 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-672034d3-a197-4fe7-90c3-a54449c1a1e2 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:54:03.530334 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-672034d3-a197-4fe7-90c3-a54449c1a1e2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.414098 Sep 01 13:54:03.530334 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Sep 1 13:54:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:03.536685 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-b995f895-3176-4f73-a42c-0226a5a4603c admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:03.541505 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:54:03.562171 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-b995f895-3176-4f73-a42c-0226a5a4603c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029076 Sep 01 13:54:03.562738 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Sep 1 13:54:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:54:03.572612 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-4267cc72-ff61-4407-b45b-549b11b1a52b admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:03.595024 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-4267cc72-ff61-4407-b45b-549b11b1a52b admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026056 Sep 01 13:54:03.595570 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Sep 1 13:54:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:54:03.605961 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-26e58011-3b89-494f-8609-ed1c95392b76 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:03.612221 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.wsgi [None req-26e58011-3b89-494f-8609-ed1c95392b76 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-26e58011-3b89-494f-8609-ed1c95392b76 admin admin] Request method failure captured: Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Accept: application/json Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Accept-Encoding: gzip, deflate Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Connection: keep-alive Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Content-Length: 0 Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Host: 10.222.0.61 Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Openstack-Api-Version: compute 2.90 Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Openstack-System-Scope: None Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: User-Agent: python-novaclient Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Auth-Token: gAAAAABjELl66RlIuIcflM0LMXMIsM9lI7eHGcfzqs_KayrqJ45HIX0_VVlqdvM1X5NHBARB8pDWEHjCgOMXmEut24B78XP8FPiOeB329DiaSiAg_4IJdmregwVufrpIVkgw7F5Ekxdf2L8c0fjaX0V4UusRSREpJZAERK9r44nex-0OuF12ahI Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Domain-Id: None Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Domain-Name: None Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Identity-Status: Confirmed Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Is-Admin-Project: True Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Project-Domain-Id: default Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Project-Domain-Name: Default Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Project-Id: 17c0369ad3194a3b8c268accfe2208d0 Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Project-Name: admin Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Role: admin,member,reader Sep 01 13:54:03.615101 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Roles: admin,member,reader Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_17c0369ad3194a3b8c268accfe2208d0"}]}] Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Tenant: admin Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Tenant-Id: 17c0369ad3194a3b8c268accfe2208d0 Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Tenant-Name: admin Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User: admin Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User-Domain-Id: default Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User-Domain-Name: Default Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User-Id: 2afeb1cf31eb47f9a0c823030df9f4cb Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User-Name: admin Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: method: > Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: exception: Flavor 42 could not be found. Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: action_args: {'id': '42'} Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:54:03.618371 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:03.619312 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:03.620579 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-26e58011-3b89-494f-8609-ed1c95392b76 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:54:03.622094 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-26e58011-3b89-494f-8609-ed1c95392b76 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015007 Sep 01 13:54:03.622094 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Sep 1 13:54:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:04.665391 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-4267cc72-ff61-4407-b45b-549b11b1a52b admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:04.666802 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-4267cc72-ff61-4407-b45b-549b11b1a52b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002497 Sep 01 13:54:04.667353 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 1 13:54:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:05.309564 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-9b5e36d3-1f2c-4f85-9a90-3ce8f63c0cf9 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:05.317846 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.wsgi [None req-9b5e36d3-1f2c-4f85-9a90-3ce8f63c0cf9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-9b5e36d3-1f2c-4f85-9a90-3ce8f63c0cf9 admin admin] Request method failure captured: Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Accept: application/json Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Accept-Encoding: gzip, deflate Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Connection: keep-alive Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Content-Length: 0 Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Host: 10.222.0.61 Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Openstack-Api-Version: compute 2.90 Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Openstack-System-Scope: None Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: User-Agent: python-novaclient Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Auth-Token: gAAAAABjELl8D9soEK67rHZ9A3tb0SKjD9wO2LT-jg_wd1Ket3KWpWViVc1v0bNEODW72IvUKOvkRWP2Q4uXI_eMwhpNFMzGgZxM4WS_BsFN2pqey7jQhF4eMdeH5LLMXMY4_S-VzF_gQXFYllJHJoyeOL9OBIH2MYJOol0UiTU8ixBk-3GzuBU Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Domain-Id: None Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Domain-Name: None Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Identity-Status: Confirmed Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Is-Admin-Project: True Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Project-Domain-Id: default Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Project-Domain-Name: Default Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Project-Id: 17c0369ad3194a3b8c268accfe2208d0 Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Project-Name: admin Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Role: admin,member,reader Sep 01 13:54:05.320886 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Roles: admin,member,reader Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_17c0369ad3194a3b8c268accfe2208d0"}]}] Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Tenant: admin Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Tenant-Id: 17c0369ad3194a3b8c268accfe2208d0 Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Tenant-Name: admin Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User: admin Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User-Domain-Id: default Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User-Domain-Name: Default Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User-Id: 2afeb1cf31eb47f9a0c823030df9f4cb Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User-Name: admin Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: method: > Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: exception: Flavor 84 could not be found. Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: action_args: {'id': '84'} Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:54:05.323081 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:05.323890 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:05.325968 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-9b5e36d3-1f2c-4f85-9a90-3ce8f63c0cf9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:54:05.328108 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-9b5e36d3-1f2c-4f85-9a90-3ce8f63c0cf9 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.513642 Sep 01 13:54:05.328108 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Sep 1 13:54:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 515 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:05.335279 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-ac87c339-8f0f-4457-93cf-6e78220af829 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:05.353066 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-ac87c339-8f0f-4457-93cf-6e78220af829 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021626 Sep 01 13:54:05.353656 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Sep 1 13:54:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:54:05.366821 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-34c7af51-1e84-4386-8728-b78b41bb52f7 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:05.394950 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-34c7af51-1e84-4386-8728-b78b41bb52f7 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034181 Sep 01 13:54:05.395957 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Sep 1 13:54:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:54:05.410065 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-436b1649-71ce-4e82-904f-4b74d87fc1f5 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:05.417190 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.wsgi [None req-436b1649-71ce-4e82-904f-4b74d87fc1f5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-436b1649-71ce-4e82-904f-4b74d87fc1f5 admin admin] Request method failure captured: Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Accept: application/json Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Accept-Encoding: gzip, deflate Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Connection: keep-alive Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Content-Length: 0 Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Host: 10.222.0.61 Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Openstack-Api-Version: compute 2.90 Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Openstack-System-Scope: None Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: User-Agent: python-novaclient Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Auth-Token: gAAAAABjELl8D9soEK67rHZ9A3tb0SKjD9wO2LT-jg_wd1Ket3KWpWViVc1v0bNEODW72IvUKOvkRWP2Q4uXI_eMwhpNFMzGgZxM4WS_BsFN2pqey7jQhF4eMdeH5LLMXMY4_S-VzF_gQXFYllJHJoyeOL9OBIH2MYJOol0UiTU8ixBk-3GzuBU Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Domain-Id: None Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Domain-Name: None Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Identity-Status: Confirmed Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Is-Admin-Project: True Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Project-Domain-Id: default Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Project-Domain-Name: Default Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Project-Id: 17c0369ad3194a3b8c268accfe2208d0 Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Project-Name: admin Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Role: admin,member,reader Sep 01 13:54:05.418271 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Roles: admin,member,reader Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_17c0369ad3194a3b8c268accfe2208d0"}]}] Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Tenant: admin Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Tenant-Id: 17c0369ad3194a3b8c268accfe2208d0 Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Tenant-Name: admin Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User: admin Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User-Domain-Id: default Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User-Domain-Name: Default Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User-Id: 2afeb1cf31eb47f9a0c823030df9f4cb Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User-Name: admin Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: method: > Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: exception: Flavor 84 could not be found. Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: action_args: {'id': '84'} Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:54:05.420664 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:05.422325 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:05.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-436b1649-71ce-4e82-904f-4b74d87fc1f5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:54:05.426379 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-436b1649-71ce-4e82-904f-4b74d87fc1f5 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013478 Sep 01 13:54:05.426379 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Thu Sep 1 13:54:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:06.997494 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-34c7af51-1e84-4386-8728-b78b41bb52f7 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:06.998544 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-34c7af51-1e84-4386-8728-b78b41bb52f7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001753 Sep 01 13:54:06.998944 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 1 13:54:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:54:07.601920 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-e9c88a7e-32bd-41fa-87fb-2629dda0b0ef admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:07.608407 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.wsgi [None req-e9c88a7e-32bd-41fa-87fb-2629dda0b0ef admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-e9c88a7e-32bd-41fa-87fb-2629dda0b0ef admin admin] Request method failure captured: Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Accept: application/json Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Accept-Encoding: gzip, deflate Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Connection: keep-alive Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Content-Length: 0 Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Host: 10.222.0.61 Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Openstack-Api-Version: compute 2.90 Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Openstack-System-Scope: None Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: User-Agent: python-novaclient Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Auth-Token: gAAAAABjELl-8Ag3YNbVh-wWMFY-0IetuXMnY2pGwsH0BqBNigqDvImHwCycCgUh0nT4W7P-XLhoU7vu6HZgzqG9-JFp0bBIR0LjBmJZNZoKAR_HuivqiFsiAkDDmWUMZrMg3fEk3lyXniP5Mns36fklpfjArTmtrJlrrYPoDQ8cJTeZCZRe9d8 Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Domain-Id: None Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Domain-Name: None Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Identity-Status: Confirmed Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Is-Admin-Project: True Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Project-Domain-Id: default Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Project-Domain-Name: Default Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Project-Id: 17c0369ad3194a3b8c268accfe2208d0 Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Project-Name: admin Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Role: admin,member,reader Sep 01 13:54:07.610275 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Roles: admin,member,reader Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_17c0369ad3194a3b8c268accfe2208d0"}]}] Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Tenant: admin Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Tenant-Id: 17c0369ad3194a3b8c268accfe2208d0 Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-Tenant-Name: admin Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User: admin Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User-Domain-Id: default Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User-Domain-Name: Default Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User-Id: 2afeb1cf31eb47f9a0c823030df9f4cb Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: X-User-Name: admin Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: method: > Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: exception: Flavor 451 could not be found. Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: action_args: {'id': '451'} Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:54:07.612070 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:07.613138 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: ERROR nova.api.openstack.wsgi Sep 01 13:54:07.623332 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-e9c88a7e-32bd-41fa-87fb-2629dda0b0ef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:54:07.625247 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-e9c88a7e-32bd-41fa-87fb-2629dda0b0ef admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.474787 Sep 01 13:54:07.625247 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Sep 1 13:54:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 476 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 13:54:07.625513 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-d49b75d7-f6c5-4110-ad35-7ba5a5c9fb4c admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:07.641994 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-d49b75d7-f6c5-4110-ad35-7ba5a5c9fb4c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021928 Sep 01 13:54:07.642582 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Sep 1 13:54:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:54:07.654874 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:07.673197 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022751 Sep 01 13:54:07.673818 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Thu Sep 1 13:54:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 13:54:07.685179 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-6ae65b54-fd1e-4438-8aba-52505d22e528 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:07.691732 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.wsgi [None req-6ae65b54-fd1e-4438-8aba-52505d22e528 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-6ae65b54-fd1e-4438-8aba-52505d22e528 admin admin] Request method failure captured: Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Accept: application/json Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Accept-Encoding: gzip, deflate Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Connection: keep-alive Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Content-Length: 0 Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Host: 10.222.0.61 Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Openstack-Api-Version: compute 2.90 Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Openstack-System-Scope: None Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: User-Agent: python-novaclient Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Auth-Token: gAAAAABjELl-8Ag3YNbVh-wWMFY-0IetuXMnY2pGwsH0BqBNigqDvImHwCycCgUh0nT4W7P-XLhoU7vu6HZgzqG9-JFp0bBIR0LjBmJZNZoKAR_HuivqiFsiAkDDmWUMZrMg3fEk3lyXniP5Mns36fklpfjArTmtrJlrrYPoDQ8cJTeZCZRe9d8 Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Domain-Id: None Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Domain-Name: None Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Identity-Status: Confirmed Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Is-Admin-Project: True Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Project-Domain-Id: default Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Project-Domain-Name: Default Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Project-Id: 17c0369ad3194a3b8c268accfe2208d0 Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Project-Name: admin Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Role: admin,member,reader Sep 01 13:54:07.693350 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Roles: admin,member,reader Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/17c0369ad3194a3b8c268accfe2208d0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_17c0369ad3194a3b8c268accfe2208d0"}]}] Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Tenant: admin Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Tenant-Id: 17c0369ad3194a3b8c268accfe2208d0 Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-Tenant-Name: admin Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User: admin Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User-Domain-Id: default Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User-Domain-Name: Default Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User-Id: 2afeb1cf31eb47f9a0c823030df9f4cb Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: X-User-Name: admin Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: method: > Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: exception: Flavor 451 could not be found. Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: action_args: {'id': '451'} Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 13:54:07.696519 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:07.698227 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: ERROR nova.api.openstack.wsgi Sep 01 13:54:07.700241 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-6ae65b54-fd1e-4438-8aba-52505d22e528 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 13:54:07.702229 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-6ae65b54-fd1e-4438-8aba-52505d22e528 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013614 Sep 01 13:54:07.702229 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Sep 1 13:54:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 13:54:08.722282 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:08.725732 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 01 13:54:08.725732 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 1 13:54:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:09.296845 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-89a1a057-91a4-45ba-ac31-e219cef40fe0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:09.413485 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-89a1a057-91a4-45ba-ac31-e219cef40fe0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.547026 Sep 01 13:54:09.415138 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Sep 1 13:54:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:54:10.418071 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:10.419087 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 01 13:54:10.419489 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 1 13:54:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:54:11.039840 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-e492602f-af32-4ceb-9f50-c9bce71bfcd8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:11.146482 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-e492602f-af32-4ceb-9f50-c9bce71bfcd8 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.586182 Sep 01 13:54:11.146939 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Sep 1 13:54:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:54:12.181350 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:12.182499 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Sep 01 13:54:12.182974 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 1 13:54:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:12.800683 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-5de4795f-cea3-428e-aa03-cbf976f9df78 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:12.890944 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-5de4795f-cea3-428e-aa03-cbf976f9df78 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.561387 Sep 01 13:54:12.891739 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Sep 1 13:54:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:54:13.994091 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:13.995106 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 01 13:54:13.995504 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 1 13:54:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:54:14.682786 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-ed4020e3-b1d9-48a3-9081-972524a13b44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 13:54:14.782392 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-ed4020e3-b1d9-48a3-9081-972524a13b44 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.644732 Sep 01 13:54:14.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Thu Sep 1 13:54:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 13:54:15.893364 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:15.894885 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001681 Sep 01 13:54:15.895321 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 1 13:54:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:54:16.581524 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-f00c57e4-59d4-4069-a21e-ef73038587d6 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:54:16.605161 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-f00c57e4-59d4-4069-a21e-ef73038587d6 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.567328 Sep 01 13:54:16.605801 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Thu Sep 1 13:54:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:55:16.655798 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:16.656805 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-abced068-58eb-4503-9952-b09e0ba80439 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 01 13:55:16.657231 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 931 bytes} [Thu Sep 1 13:55:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:55:16.666301 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:17.127636 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-9df79bda-c8b0-4913-aa54-29893e85c9cc admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:17.151212 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-9df79bda-c8b0-4913-aa54-29893e85c9cc admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.486298 Sep 01 13:55:17.151813 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1292 bytes} [Thu Sep 1 13:55:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:55:17.179497 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG dbcounter [-] [112391] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:55:17.183540 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-3bf1a661-b15c-446c-8604-c0961e686b26 admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:17.191720 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-3bf1a661-b15c-446c-8604-c0961e686b26 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013565 Sep 01 13:55:17.192843 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1283 bytes} [Thu Sep 1 13:55:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:17.205175 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-cb5002e8-2b1d-46ac-bd0a-7e4ed5488541 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:17.213543 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-cb5002e8-2b1d-46ac-bd0a-7e4ed5488541 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012043 Sep 01 13:55:17.214150 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1286 bytes} [Thu Sep 1 13:55:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:17.227803 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-a999b3c0-c7ea-4f4a-9a54-6a68ffb59dfb admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:17.236092 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-a999b3c0-c7ea-4f4a-9a54-6a68ffb59dfb admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012218 Sep 01 13:55:17.236685 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1286 bytes} [Thu Sep 1 13:55:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:55:17.250445 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-3a33be40-bdd9-463d-a644-8d3a29574c71 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:55:17.259718 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-3a33be40-bdd9-463d-a644-8d3a29574c71 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013477 Sep 01 13:55:17.260292 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1283 bytes} [Thu Sep 1 13:55:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 13:58:31.660888 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-a999b3c0-c7ea-4f4a-9a54-6a68ffb59dfb admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:31.662007 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-a999b3c0-c7ea-4f4a-9a54-6a68ffb59dfb admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Sep 01 13:58:31.662422 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 1 13:58:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:31.807983 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writing DB stats nova_api:SELECT=6 {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:31.981855 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-3c75f7c1-84c9-4a2c-beb5-61b61bcf7b05 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:31.985736 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-3c75f7c1-84c9-4a2c-beb5-61b61bcf7b05 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:31.986244 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-3c75f7c1-84c9-4a2c-beb5-61b61bcf7b05 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:31.986705 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-3c75f7c1-84c9-4a2c-beb5-61b61bcf7b05 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:31.987430 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-3c75f7c1-84c9-4a2c-beb5-61b61bcf7b05 admin admin] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:31.987888 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-3c75f7c1-84c9-4a2c-beb5-61b61bcf7b05 admin admin] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:31.988297 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-3c75f7c1-84c9-4a2c-beb5-61b61bcf7b05 admin admin] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:32.025497 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-3c75f7c1-84c9-4a2c-beb5-61b61bcf7b05 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.219020 Sep 01 13:58:32.026115 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Sep 1 13:58:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:58:32.935017 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-a999b3c0-c7ea-4f4a-9a54-6a68ffb59dfb admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:32.936170 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-a999b3c0-c7ea-4f4a-9a54-6a68ffb59dfb admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Sep 01 13:58:32.936625 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 1 13:58:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:33.139747 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-96b0c799-3657-4e21-932c-07cddbce66b0 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:33.145850 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-96b0c799-3657-4e21-932c-07cddbce66b0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:33.146676 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-96b0c799-3657-4e21-932c-07cddbce66b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:33.147472 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-96b0c799-3657-4e21-932c-07cddbce66b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:33.148726 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-96b0c799-3657-4e21-932c-07cddbce66b0 admin admin] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:33.149321 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-96b0c799-3657-4e21-932c-07cddbce66b0 admin admin] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:33.150088 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-96b0c799-3657-4e21-932c-07cddbce66b0 admin admin] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:33.187302 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-96b0c799-3657-4e21-932c-07cddbce66b0 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.108131 Sep 01 13:58:33.187967 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Sep 1 13:58:33 2022] GET /compute/v2.1/os-services => generated 791 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 13:58:44.429955 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-a999b3c0-c7ea-4f4a-9a54-6a68ffb59dfb admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:44.430878 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-a999b3c0-c7ea-4f4a-9a54-6a68ffb59dfb admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Sep 01 13:58:44.431286 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 1 13:58:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 13:58:44.580216 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writing DB stats nova_cell0:SELECT=4 {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:44.581039 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writing DB stats nova_cell1:SELECT=4 {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:44.581570 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG dbcounter [-] [112390] Writing DB stats nova_api:SELECT=8 {{(pid=112390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 13:58:44.657342 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-d15037e8-7f53-403e-bde1-07bb77e3c768 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:44.662135 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-d15037e8-7f53-403e-bde1-07bb77e3c768 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:44.662625 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-d15037e8-7f53-403e-bde1-07bb77e3c768 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:44.663062 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-d15037e8-7f53-403e-bde1-07bb77e3c768 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:44.663797 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-d15037e8-7f53-403e-bde1-07bb77e3c768 admin admin] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:44.664302 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-d15037e8-7f53-403e-bde1-07bb77e3c768 admin admin] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:44.664723 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-d15037e8-7f53-403e-bde1-07bb77e3c768 admin admin] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:44.693701 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-d15037e8-7f53-403e-bde1-07bb77e3c768 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.117885 Sep 01 13:58:44.694310 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 38/74] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Sep 1 13:58:44 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:58:45.544533 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: DEBUG nova.api.openstack.wsgi [None req-a999b3c0-c7ea-4f4a-9a54-6a68ffb59dfb admin admin] Calling method '>' {{(pid=112391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:45.545542 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: INFO nova.api.openstack.requestlog [None req-a999b3c0-c7ea-4f4a-9a54-6a68ffb59dfb admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Sep 01 13:58:45.545986 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: [pid: 112391|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1074 bytes} [Thu Sep 1 13:58:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 13:58:45.741564 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG nova.api.openstack.wsgi [None req-686756b0-897f-42bc-994d-b9d6bb81bbc3 admin admin] Calling method '>' {{(pid=112390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 13:58:45.745063 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-686756b0-897f-42bc-994d-b9d6bb81bbc3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:45.745543 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-686756b0-897f-42bc-994d-b9d6bb81bbc3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:45.746018 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-686756b0-897f-42bc-994d-b9d6bb81bbc3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:45.746994 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-686756b0-897f-42bc-994d-b9d6bb81bbc3 admin admin] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:58:45.748003 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-686756b0-897f-42bc-994d-b9d6bb81bbc3 admin admin] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:58:45.748427 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: DEBUG oslo_concurrency.lockutils [None req-686756b0-897f-42bc-994d-b9d6bb81bbc3 admin admin] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:58:45.771796 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: INFO nova.api.openstack.requestlog [None req-686756b0-897f-42bc-994d-b9d6bb81bbc3 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084580 Sep 01 13:58:45.772339 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: [pid: 112390|app: 0|req: 39/76] 10.222.0.61 () {60 vars in 1193 bytes} [Thu Sep 1 13:58:45 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 13:59:42.825278 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: Thu Sep 1 13:59:42 2022 - graceful shutdown triggered... Sep 01 13:59:42.825860 dv-cinder-852210-7-iscsi devstack@n-api.service[112391]: Gracefully killing worker 2 (pid: 112391)... Sep 01 13:59:42.826228 dv-cinder-852210-7-iscsi devstack@n-api.service[112390]: Gracefully killing worker 1 (pid: 112390)... Sep 01 13:59:42.829145 dv-cinder-852210-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 13:59:43.825479 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: worker 1 buried after 1 seconds Sep 01 13:59:43.825479 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: worker 2 buried after 1 seconds Sep 01 13:59:43.825479 dv-cinder-852210-7-iscsi devstack@n-api.service[112389]: goodbye to uWSGI. Sep 01 13:59:43.827100 dv-cinder-852210-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 13:59:43.827662 dv-cinder-852210-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 13:59:43.830478 dv-cinder-852210-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 13:59:43.840107 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 13:59:43.842747 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 13:59:43 2022] *** Sep 01 13:59:43.842924 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 13:59:43.843147 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 13:59:43.843255 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: nodename: dv-cinder-852210-7-iscsi Sep 01 13:59:43.843347 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: machine: x86_64 Sep 01 13:59:43.843457 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: clock source: unix Sep 01 13:59:43.843574 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: pcre jit disabled Sep 01 13:59:43.843690 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: detected number of CPU cores: 4 Sep 01 13:59:43.843807 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: current working directory: / Sep 01 13:59:43.843943 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: detected binary path: /usr/bin/uwsgi-core Sep 01 13:59:43.843943 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: your processes number limit is 47680 Sep 01 13:59:43.843943 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: your memory page size is 4096 bytes Sep 01 13:59:43.843943 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: detected max file descriptor number: 2048 Sep 01 13:59:43.843943 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: lock engine: pthread robust mutexes Sep 01 13:59:43.844471 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: thunder lock: enabled Sep 01 13:59:43.844471 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 13:59:43.844471 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 13:59:43.885799 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: Python main interpreter initialized at 0x55b923c519c0 Sep 01 13:59:43.885799 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: python threads support enabled Sep 01 13:59:43.885799 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: your server socket listen backlog is limited to 100 connections Sep 01 13:59:43.885799 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: your mercy for graceful operations on workers is 90 seconds Sep 01 13:59:43.885799 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 13:59:43.885799 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: *** Operational MODE: preforking *** Sep 01 13:59:43.886658 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: *** uWSGI is running in multiple interpreter mode *** Sep 01 13:59:43.886658 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: spawned uWSGI master process (pid: 127794) Sep 01 13:59:43.886363 dv-cinder-852210-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 13:59:43.887117 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: spawned uWSGI worker 1 (pid: 127811, cores: 1) Sep 01 13:59:43.887252 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: spawned uWSGI worker 2 (pid: 127812, cores: 1) Sep 01 13:59:43.887394 dv-cinder-852210-7-iscsi devstack@n-api.service[127794]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 13:59:44.569957 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 13:59:44.570560 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 13:59:45.735761 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:59:45.735761 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: from cryptography.utils import int_from_bytes Sep 01 13:59:45.736399 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:59:45.736399 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: from cryptography.utils import int_from_bytes Sep 01 13:59:45.736797 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:59:45.736797 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: from cryptography.utils import int_from_bytes Sep 01 13:59:45.736924 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 13:59:45.736924 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: from cryptography.utils import int_from_bytes Sep 01 13:59:48.210389 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:59:48.211174 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:59:48.211174 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:59:48.212154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:59:48.212154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:59:48.212154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.212516 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.212814 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.213144 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 13:59:48.213527 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.213603 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 13:59:48.213696 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.213806 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.213997 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 13:59:48.214111 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.214292 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 13:59:48.214400 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.214560 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 13:59:48.214722 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.214932 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.215042 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.215256 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.215394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.215581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.215682 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-7-iscsi {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.215900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.216074 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.216234 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.216412 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.216523 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.216701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.216875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.217070 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.217226 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.217933 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.218084 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.218239 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.218436 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.218597 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.218758 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.218915 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852210-7-iscsi {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.219113 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.219402 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.219585 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.219798 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.219958 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.220106 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.220261 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.220415 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.220570 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.220740 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.220888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.221034 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.221191 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.221348 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.221493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.221703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.221898 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.222048 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.222193 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.222337 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.222503 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.222717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.222926 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-7-iscsi {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.223088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.223232 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.223386 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.223540 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.223694 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.223848 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.224003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.224154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.224317 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.224457 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.224626 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.224778 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.224915 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.225052 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.225313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852210-7-iscsi {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.225456 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.225693 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.225893 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.226033 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.226195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.226334 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.226484 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.227220 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.227595 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.227900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.228306 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.228968 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.229316 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.229667 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.230057 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.230466 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.230840 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.231147 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.231370 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.231527 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.232158 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.232158 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.232476 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.232631 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.232786 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.233023 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.233230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.233391 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.233540 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.234337 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.234521 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.234831 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.235118 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.235338 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.235496 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.235647 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.235801 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.235948 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.236230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.236333 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.236442 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.236584 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.236696 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.236798 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.236898 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.236982 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.237085 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.237247 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.237409 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.237576 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.237726 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.237726 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.238108 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.238266 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.238426 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.238586 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.238746 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.238906 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.239063 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.239220 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.239389 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.239551 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.239727 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.239876 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.240035 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.240193 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.240353 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.240501 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.240649 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.240806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.240954 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.241101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.241266 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.241427 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.241427 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.241733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.241921 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.242088 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.242251 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.242416 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.242567 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.242718 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.242718 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.243041 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.243041 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.243327 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.243484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.243642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.243642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.243934 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.244096 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.244244 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.244244 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.244545 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.244701 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.244874 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.244874 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.245165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.245328 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.245459 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.245602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.245832 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.245973 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.246122 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.246291 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.246700 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.246870 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.247051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.247187 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.247332 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.247332 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.247615 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.247779 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.247937 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.248096 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.248263 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.248415 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.248570 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.248736 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.248887 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.249040 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.249199 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.249360 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.249520 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.249690 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.249862 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.250028 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.250177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.250324 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.250472 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.250641 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.250792 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.250929 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.251059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.251209 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.251380 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.251541 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.251699 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.251875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.252036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.252187 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.252349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.252500 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.252656 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.252831 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.252938 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.253030 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.253115 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.253204 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.253287 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.253378 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.253463 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.253544 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.253626 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.253756 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.253951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.254041 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.254149 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.254302 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.254473 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.254643 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.254808 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.254967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.255127 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.255287 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.255451 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.255600 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.255767 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.255916 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.256075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.256237 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.256396 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.256556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.256718 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.256865 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.257023 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.257193 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.257342 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.257498 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.257657 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.257862 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.258013 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.258180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.258342 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.258504 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.258653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.258801 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.259026 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.259197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.259345 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.259502 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.259703 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.259837 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.259991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.260124 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.260124 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.260376 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.260529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.260689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.260856 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.261019 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.261154 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.261301 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.261435 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.261577 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.261726 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.261888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.262023 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.262173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.262317 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.262450 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.262704 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 13:59:48.262848 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.262980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.263112 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.263242 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.263393 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.263538 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.263672 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.263802 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.265958 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.266196 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.266426 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.266648 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.266861 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.267084 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.267260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.267410 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.267579 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.267732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.267888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.267888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.267888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.267888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.268461 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.268639 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.268790 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.268959 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.269108 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.269267 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.269420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.269586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.269750 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.270032 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.270204 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.270358 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.270524 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.270689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.270855 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.270855 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.271260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.271260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.271660 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.271817 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.271964 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.272112 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.272272 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.272433 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.272602 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.272760 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.272955 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.273166 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.273378 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.273585 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.273818 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.274032 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.274235 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.274437 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.274640 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.274847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.275032 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.275216 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.275416 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.275614 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.275815 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.276018 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.276199 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.276393 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.276575 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.276772 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.276965 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.277159 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.277327 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.277550 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.278045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.278214 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.278361 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.278571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.278764 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.278957 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.279164 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.279366 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.279528 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.280252 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.280401 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.280552 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.280684 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.280832 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.281046 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.281245 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.281457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.281641 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.281802 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.281934 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.282078 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.282251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.282403 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.282552 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.282680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.282808 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.282952 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.283081 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.283217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.283217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.283217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.283217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.283217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.283706 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.283796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.283907 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.283999 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.284096 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.284181 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.284262 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.284344 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.284425 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.284506 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.284626 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.284724 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.284865 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.285020 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.285153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.285317 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.285486 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.285654 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.285811 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.285912 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.286005 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.286158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.286261 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.286353 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.286436 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.286517 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.286598 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.286689 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.286772 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.286896 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.287022 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.287136 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.287238 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.287340 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.287433 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.287525 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.287616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.287727 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.287826 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.287993 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.288179 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.288377 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.288575 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.288727 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.288878 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.289011 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.289135 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.289259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.289361 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.289503 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.289607 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.289727 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.289851 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.289938 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.289938 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.290100 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.290196 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.290280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.290389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.290530 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.290692 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.290855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.291121 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.291323 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.291419 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.291503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.291586 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.291675 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.291767 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.291851 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.291931 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.292011 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.292099 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.292196 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.292288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.292379 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.292462 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.292543 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.292633 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.292728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.292866 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.293004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.293132 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.293267 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.293355 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.293450 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.293580 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.293675 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.293808 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.293907 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.293992 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.294084 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.294168 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.294256 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.294339 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.294428 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.294519 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.294602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.294684 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.294765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.294846 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.294927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.295022 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.295147 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.295241 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.295324 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.295411 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.295504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.295651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.295795 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.295883 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.295964 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.296053 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.296143 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.296234 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.296324 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.296414 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.296503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.296594 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.296746 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.296835 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.296924 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.297007 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.297097 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.297179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.297269 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.297360 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.297443 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.297581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.297698 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.297851 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.297950 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.298042 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.298164 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.298253 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.298588 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.298728 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.298859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.298995 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.299246 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.299368 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.299478 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.299600 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.299727 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.299844 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.299954 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.300071 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.300180 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.300302 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.300413 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.300538 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.300647 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.300755 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.300882 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.301018 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.301136 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.301247 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.301361 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.301479 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.301588 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.301588 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.301588 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.301990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.302098 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.302206 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.302313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.302440 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.302551 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.302657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.302773 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.302883 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.303005 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.303122 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.303237 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.303354 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.303471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.303587 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.303709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.303826 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.303936 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.304054 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.304193 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.304328 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.304468 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.304608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.304743 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.304877 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.305005 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.305139 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.305280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.305452 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.305603 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.305787 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.305922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.306229 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.306542 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.306855 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.307166 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.307473 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.307781 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.308093 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.308409 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.308722 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.309035 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.309340 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.309655 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.310006 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.310314 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.310618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.311112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.311744 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.312174 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.312672 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.313169 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.313576 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.317793 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.317793 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.318574 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.318673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.318760 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.318854 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.318947 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.319042 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.319042 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.319211 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.319294 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.319376 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.319457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.319548 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.319631 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.319721 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.319811 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.319901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.319990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.320086 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.320169 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.320250 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.320335 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.320425 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.320514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.320514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.320514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.320514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.320514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.320514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.320514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.320514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.321174 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.321174 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.321174 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.321397 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.321522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.321889 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.322015 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.322183 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.322288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.322472 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.322622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.322872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.323200 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.323518 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.323636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.323862 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.323978 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.324585 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.324705 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.324813 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.324909 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.325010 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.325112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.325204 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.325293 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.325450 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.325568 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.325806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.326143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.326272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.326971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.327286 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.327385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.327593 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.327693 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.327931 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.328044 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.328208 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.328307 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.328549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.328652 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.328810 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.328953 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.329183 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.329402 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.329502 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.329716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.329909 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.330076 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.330241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.330434 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.330583 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.330737 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.330898 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.331054 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.331201 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.331347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.331500 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.331666 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.331822 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.331977 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.332123 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.332270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.332416 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.332560 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.332714 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.332881 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.333376 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.333538 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.333684 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.333861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.333861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.334175 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.334351 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.334628 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.334806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.334966 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.335113 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.335261 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.335407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.335560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.335726 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.336089 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.336448 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.336611 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.336774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.336936 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.337082 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.337236 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.337390 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.337546 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.337702 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.337882 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.338077 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.338229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.338383 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.338550 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.338805 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.338962 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.339133 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.339432 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.339583 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.339737 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.339892 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.340038 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.340191 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.340337 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.340482 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.340638 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.340804 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.340952 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.341105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.341258 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.341404 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.342668 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.342824 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.343019 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.343514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.343670 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.343818 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.343980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.344128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.344284 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.344439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.344439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.344716 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.344873 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.345026 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.345181 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.345334 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.345532 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.345681 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.345861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.346182 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.346466 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.346622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.346769 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.346971 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.347238 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.347387 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.347585 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.347751 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.347909 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.347909 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.348256 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.348403 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.348557 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.348822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.348986 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.349142 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.349296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.349443 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.349596 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.349743 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.349935 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.350097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.350291 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.350454 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.350719 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.350877 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.351046 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.351241 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.351404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.351551 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.351711 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.351858 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.352029 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.352177 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.352322 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.352475 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.352629 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.352774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.352928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.353086 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.353552 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.353713 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.353932 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.354079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.354239 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.354386 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.354531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.354676 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.354821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.355045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.355193 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.355350 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.355496 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.355650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.355796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.355955 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.356268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.356435 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.357389 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.357553 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.357819 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.357990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.358370 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.358543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.358706 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.358872 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.359099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.359260 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.359408 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.359554 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.359707 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.359854 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.360009 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.360156 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.360300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.360454 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.360454 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.360744 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.360900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.361055 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.361202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.361347 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.361347 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.361640 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.361910 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.362065 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.362211 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.362357 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.362503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.362649 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.362818 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.362973 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.362973 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.363278 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.363278 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.363960 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.364200 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.364350 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.364511 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.364669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.364816 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.364978 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.365126 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.365292 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.365559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.365727 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.365929 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.366093 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.366456 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.366611 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.366915 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.367083 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.367233 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.367532 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.367698 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.367875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.368185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.368387 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.368539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.368701 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.368851 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.369005 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.369267 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.369429 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.369586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.369734 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.369904 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.370064 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.370224 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.370379 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.370539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.370686 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.370686 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.370973 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.371274 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.371717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.371889 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.372046 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.372206 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.372367 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.372519 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.372686 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.372852 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.373015 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.373178 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.373363 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.373654 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.374267 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.374267 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.374581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.374744 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.374905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.374905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.375209 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.375383 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.375537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.375695 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.375856 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.376017 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.376179 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.376554 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.376720 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.376883 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.376883 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.377326 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.377326 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.377833 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.378010 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.378164 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.378317 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.378530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.378530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.378844 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.378998 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.379171 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.379445 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.379658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.379818 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.379979 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.380143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.380296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.380449 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.380615 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.380768 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.380929 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.381082 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.381242 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.381396 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.381560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.381713 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.381713 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.382030 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.382361 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.382534 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.382696 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.382857 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.383010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.383170 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.383323 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.383491 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.383770 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.384149 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.384427 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.384595 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.384750 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.384923 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.385094 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.385308 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.385474 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.385637 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.385890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.385890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.386220 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.386380 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.386767 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.386937 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.387260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.387444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.387444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.387750 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.388051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.388214 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.388377 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.388377 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.388746 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.389528 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.389701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.389979 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.389979 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.390296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.390469 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.390623 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.390783 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.390937 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.391110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.391271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.391424 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.391424 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.391721 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.391885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.391885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.392189 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.392342 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.392512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.392675 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.392675 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.392972 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.393149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.393320 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.393483 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.393644 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.393950 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.394339 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.395206 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.395206 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.396464 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.396661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.397026 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.397190 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.397484 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.397645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.397645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.398224 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.398396 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.398552 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.398757 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.398914 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.399079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.399079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.399401 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.399575 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.399821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.399995 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.400165 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.400320 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.400473 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.400625 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.400777 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.400944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.400944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.401309 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.401309 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.401619 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.401619 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.405429 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.405623 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.405843 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.406012 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.406186 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.406352 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.406517 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.406682 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.406836 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.407174 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.407350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.407644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.407811 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.407965 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.408117 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.408431 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.408602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.408823 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.408991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.409147 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.409300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.409452 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.409624 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.409860 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.409979 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.410101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.410195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.410316 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.410441 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.410537 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.410612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.410690 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.410770 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.410863 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.410962 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.411046 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.411046 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.411216 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.411307 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.411391 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.411483 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.411574 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.411658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.411740 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.411821 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.411903 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.411995 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.412080 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.412162 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.412245 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.412335 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.412419 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.412510 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.412602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.412682 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.412753 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.412822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.412900 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.412979 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.413059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.413143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.413232 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.413315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.413411 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.413494 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.413583 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.413666 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.413755 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.413871 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.413954 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414036 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414107 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414184 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414256 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414338 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414495 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414565 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414634 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414703 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414784 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414856 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414925 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.414994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.415128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.415211 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.415290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.415362 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.415432 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.415500 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.415570 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.415647 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.415719 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.415788 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.415864 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.415935 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416084 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416162 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416246 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416317 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416387 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416476 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416619 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.416973 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.417050 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.417121 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.417191 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.417259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.417337 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.417416 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.417493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.417571 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.417642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.417719 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.417810 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.417883 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.417952 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418034 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418108 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418108 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418108 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418108 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418108 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418108 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418108 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418108 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418767 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418767 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418767 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418767 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418767 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418767 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.418767 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.419202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.419290 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.419290 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.419440 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.419520 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.419598 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.419683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.419683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.419820 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.419903 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.419982 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420053 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420053 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420221 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420292 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420379 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420961 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420961 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420961 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420961 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.420961 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.421286 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.429797 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.430017 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.430017 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.430212 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.430297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.430374 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.430455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.430613 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.430698 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.430786 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.430882 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.430968 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.431051 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.431142 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.431228 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.431321 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.431405 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.431483 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.431574 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.431671 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.431755 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.431845 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.431929 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.432011 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.432107 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.432107 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.432257 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.432341 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.432425 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.432516 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.432610 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.432694 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.432791 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.432888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.432984 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.433078 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.433078 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.433239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.433322 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.433412 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.433496 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.433589 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.433680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.433875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.433982 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434076 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434166 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434262 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434347 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434529 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434619 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.434704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.435359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.435359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.435359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.435359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.435359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.435359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.435359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.435359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.435939 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.435939 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.435939 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.436168 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.441793 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.441942 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.441942 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.442103 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.442207 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.442296 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.442382 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.442466 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.442538 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.442633 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.442729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.442729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.442884 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.442968 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.443052 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.443144 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.443245 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.443331 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.443415 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.443506 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.443598 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.443691 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.443784 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.443877 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.443962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444050 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444133 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444224 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444310 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444393 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444476 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444547 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444631 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.444704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.445214 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.445214 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.445214 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.445214 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.445461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.445634 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.445737 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.446060 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.446411 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.446560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.446775 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.446878 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.447104 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.447206 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.447424 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.447536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.447718 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.447842 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.448046 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.448362 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.448655 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.448765 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.448982 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.449096 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.449307 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.449428 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.449650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.449750 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.449941 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.450059 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.452994 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.453117 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.453219 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.453298 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.453371 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.453371 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.453509 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.453592 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.453673 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.453752 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.459454 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.459620 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.459620 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.459775 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.459859 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.459934 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.460006 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.460085 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.460085 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.460244 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.460322 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.460435 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.460565 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.460667 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.460743 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.460824 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.460907 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.460982 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.461053 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.461125 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.461209 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.461290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.461363 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.461434 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.461513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.461592 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.461701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.462978 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.463167 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.463325 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.463478 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.463643 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.463813 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.463813 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.464107 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.464270 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.464454 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.464619 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.464774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.464945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.465108 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.465578 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.465734 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.465927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.466084 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.466237 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.466399 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.466552 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.466921 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.467686 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.467861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.468017 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.468182 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.468653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.469080 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.469257 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.469420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.469576 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.469741 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.469936 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.470109 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.470265 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.470424 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.470579 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.470755 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.471015 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.471316 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.471489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.471645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.471798 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.471952 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.472113 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.472281 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.472437 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.472590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.472743 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.472895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.473119 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.473285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.473439 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.473601 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.473782 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.473946 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.474183 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.474348 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.474502 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.474663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.474828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.474991 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.475174 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.475947 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.475947 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.476306 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.476467 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.476631 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.476806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.477176 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.477337 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.477490 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.477652 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.477868 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.477868 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.478194 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.478352 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.478799 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.478799 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.479460 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.479460 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.479771 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.479771 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.480064 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.480230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.480399 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.480560 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.480725 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.480885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.481047 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.481221 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.481384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.481545 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.481699 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.481920 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.482076 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.482238 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.482238 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.482542 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.482803 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.482963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.483184 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.483399 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.483568 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.483722 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.483874 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.484034 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.484208 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.484208 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.484510 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.484663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.484822 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.484986 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.484986 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.485296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.485456 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.485456 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.485748 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.485938 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.486108 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.486367 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.486542 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.486705 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.486866 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.487051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.487485 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.487663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.487819 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.487972 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.488132 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.488296 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.488632 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.489081 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.489522 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.489684 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.489859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.490028 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.490028 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.490333 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.490486 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.490648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.490810 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.490972 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.491125 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.491285 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.491529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.491687 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.491850 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.492004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.492165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.492165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.492492 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.492648 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.492814 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.492977 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.493140 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.493354 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.493514 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.493738 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.493738 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.494117 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.494284 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.494449 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.494621 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.494783 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.494951 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.495116 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.495269 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.495430 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.495634 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.495802 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.495964 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.496589 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.496756 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.496911 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.497076 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.497276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.497645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.497842 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.498011 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.498011 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.498419 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.498596 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.498752 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.498933 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.498933 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.500430 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.500607 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.500771 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.500935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.500935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.501241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.501435 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.501895 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.502124 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.502366 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.502566 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.502726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.502726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.503045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.503200 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.503428 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.503633 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.503789 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.503943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.504106 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.504106 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.504417 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.504580 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.504876 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.505008 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.505123 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.505297 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.505432 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.505548 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.505706 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.505840 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.505957 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.512542 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.512761 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.512933 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.513089 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.513243 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.513462 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.513638 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.513862 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.514530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.514695 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.514856 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.515017 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.515180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.515356 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:59:48.515511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.515511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.515511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.515511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.515511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.515511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.515511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.515511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 13:59:48.516780 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127812) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 13:59:48.557456 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO dbcounter [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] Registered counter for database nova_api Sep 01 13:59:48.558940 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO dbcounter [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] Registered counter for database nova_api Sep 01 13:59:48.579182 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_db.sqlalchemy.engines [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:59:48.580692 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_db.sqlalchemy.engines [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:59:48.586755 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writer thread running {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:59:48.588345 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writer thread running {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:59:48.650393 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.context [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8be996a3-c3dc-448b-9d29-95d2c5ed6464(cell1) {{(pid=127812) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 13:59:48.650393 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:48.650393 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:48.652454 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:48.652454 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:48.652668 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:48.654822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:48.655200 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.context [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8be996a3-c3dc-448b-9d29-95d2c5ed6464(cell1) {{(pid=127811) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 13:59:48.656791 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO dbcounter [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] Registered counter for database nova_cell0 Sep 01 13:59:48.659507 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:48.660001 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:48.660971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO dbcounter [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] Registered counter for database nova_cell1 Sep 01 13:59:48.661685 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:48.662529 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 13:59:48.662985 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 13:59:48.665124 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 13:59:48.667357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO dbcounter [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] Registered counter for database nova_cell0 Sep 01 13:59:48.671903 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_db.sqlalchemy.engines [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:59:48.672124 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO dbcounter [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] Registered counter for database nova_cell1 Sep 01 13:59:48.672768 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_db.sqlalchemy.engines [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:59:48.680074 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writer thread running {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:59:48.680323 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_db.sqlalchemy.engines [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:59:48.681531 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writer thread running {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:59:48.682255 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_db.sqlalchemy.engines [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:59:48.692536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writer thread running {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:59:48.830709 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO dbcounter [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] Registered counter for database nova_cell0 Sep 01 13:59:48.836838 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writer thread running {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:59:48.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_db.sqlalchemy.engines [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127812) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:59:48.843211 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writer thread running {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:59:48.847727 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO dbcounter [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] Registered counter for database nova_cell0 Sep 01 13:59:48.855518 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_db.sqlalchemy.engines [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 13:59:48.860270 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writer thread running {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 13:59:49.167738 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: WARNING keystonemiddleware.auth_token [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:59:49.175607 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: WARNING keystonemiddleware.auth_token [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:59:49.192501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: WARNING keystonemiddleware.auth_token [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:59:49.199876 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: WARNING keystonemiddleware.auth_token [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:59:49.525929 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: WARNING keystonemiddleware.auth_token [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:59:49.532471 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: WARNING keystonemiddleware.auth_token [None req-f594a1f9-8ebd-4ca0-9d53-1f3082b2c3c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:59:49.537717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b923c519c0 pid: 127812 (default app) Sep 01 13:59:49.552976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: WARNING keystonemiddleware.auth_token [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 13:59:49.559052 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: WARNING keystonemiddleware.auth_token [None req-76cb1f47-2126-4f66-9f5a-d63de3c2a5e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 13:59:49.564555 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b923c519c0 pid: 127811 (default app) Sep 01 14:00:28.984527 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=3 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:28.985499 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=3 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:28.986457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=3 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:28.987359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=3 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:29.123735 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=3 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:29.126105 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=3 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:29.127495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=3 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:29.137815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=3 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:00:30.488165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-95176932-0b87-410e-b8b5-2cccca5606e9 tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] Action: 'create', calling method: .version_select at 0x7f1afe3781f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-98866732", "metadata": {"Type": "work"}}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:30.548991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8e1dd20e-d7ba-401f-b8ea-3e42355e92cd tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Action: 'create', calling method: .version_select at 0x7f1afe37c1f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1743815853", "metadata": {"Type": "work"}}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8e1dd20e-d7ba-401f-b8ea-3e42355e92cd tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Request method failure captured: Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 122 Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELr9RaFsD0PQLyIx-7WGY2v5iuzdZ9SgNllUfsCQRk46HEJhM1w_RJ0cXsqx1LCiq54msdDrfFhF5sQxkTzTli9xALVVJEQG20UZcIG17ta9XveOfla_sI5Wa2HkhMk4BYQZ2p6uI4S_MkagEcgAkSGRCieUSoGVbBcRZKlITKM5Vmo Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 421b15cacc7a46388f87a068db634585 Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:00:30.559075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:00:30.560709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/421b15cacc7a46388f87a068db634585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/421b15cacc7a46388f87a068db634585"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/421b15cacc7a46388f87a068db634585"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_421b15cacc7a46388f87a068db634585"}]}] Sep 01 14:00:30.560709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:30.560709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 421b15cacc7a46388f87a068db634585 Sep 01 14:00:30.560709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:30.560709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-VolumesNegativeTest-149179289-project Sep 01 14:00:30.560709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:00:30.560709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:00:30.560709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 219806fd01d14fa58f336ea720f274b1 Sep 01 14:00:30.560709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-VolumesNegativeTest-149179289-project Sep 01 14:00:30.560709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Sep 01 14:00:30.560709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1743815853", "metadata": {"Type": "work"}}} Sep 01 14:00:30.560709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: Sep 01 14:00:30.560709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1743815853', 'metadata': {'Type': 'work'}}}} Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise error Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:30.561617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 14:00:30.562977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 14:00:30.565301 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 14:00:30.565301 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.566534 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8e1dd20e-d7ba-401f-b8ea-3e42355e92cd tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:30.568025 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8e1dd20e-d7ba-401f-b8ea-3e42355e92cd tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.454011 Sep 01 14:00:30.569173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1156 bytes} [Thu Sep 1 14:00:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1457 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:00:30.584936 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f8a4c244-e6d0-42f8-a712-251db96b672e tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Action: 'create', calling method: .version_select at 0x7f1afe37cee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1771042942", "metadata": {"Type": "work"}}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f8a4c244-e6d0-42f8-a712-251db96b672e tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Request method failure captured: Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 120 Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELr9RaFsD0PQLyIx-7WGY2v5iuzdZ9SgNllUfsCQRk46HEJhM1w_RJ0cXsqx1LCiq54msdDrfFhF5sQxkTzTli9xALVVJEQG20UZcIG17ta9XveOfla_sI5Wa2HkhMk4BYQZ2p6uI4S_MkagEcgAkSGRCieUSoGVbBcRZKlITKM5Vmo Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 421b15cacc7a46388f87a068db634585 Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:00:30.598796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:00:30.600297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/421b15cacc7a46388f87a068db634585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/421b15cacc7a46388f87a068db634585"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/421b15cacc7a46388f87a068db634585"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_421b15cacc7a46388f87a068db634585"}]}] Sep 01 14:00:30.600297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:30.600297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 421b15cacc7a46388f87a068db634585 Sep 01 14:00:30.600297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:30.600297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-VolumesNegativeTest-149179289-project Sep 01 14:00:30.600297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:00:30.600297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:00:30.600297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 219806fd01d14fa58f336ea720f274b1 Sep 01 14:00:30.600297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-VolumesNegativeTest-149179289-project Sep 01 14:00:30.600297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Sep 01 14:00:30.600297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1771042942", "metadata": {"Type": "work"}}} Sep 01 14:00:30.600297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: Sep 01 14:00:30.600297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1771042942', 'metadata': {'Type': 'work'}}}} Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise error Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi '0' Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:30.601249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 14:00:30.602723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 14:00:30.605604 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 14:00:30.605604 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.610837 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f8a4c244-e6d0-42f8-a712-251db96b672e tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:30.611917 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f8a4c244-e6d0-42f8-a712-251db96b672e tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.034758 Sep 01 14:00:30.613008 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 2/2] 10.222.0.61 () {60 vars in 1156 bytes} [Thu Sep 1 14:00:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:00:30.623785 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5b6d600b-78a8-40b4-8188-44a1e4fc40fc tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Action: 'create', calling method: .version_select at 0x7f1afe354dc0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-959626025", "metadata": {"Type": "work"}}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5b6d600b-78a8-40b4-8188-44a1e4fc40fc tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Request method failure captured: Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 118 Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELr9RaFsD0PQLyIx-7WGY2v5iuzdZ9SgNllUfsCQRk46HEJhM1w_RJ0cXsqx1LCiq54msdDrfFhF5sQxkTzTli9xALVVJEQG20UZcIG17ta9XveOfla_sI5Wa2HkhMk4BYQZ2p6uI4S_MkagEcgAkSGRCieUSoGVbBcRZKlITKM5Vmo Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 421b15cacc7a46388f87a068db634585 Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:00:30.629054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:00:30.630489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/421b15cacc7a46388f87a068db634585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/421b15cacc7a46388f87a068db634585"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/421b15cacc7a46388f87a068db634585"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_421b15cacc7a46388f87a068db634585"}]}] Sep 01 14:00:30.630489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:30.630489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 421b15cacc7a46388f87a068db634585 Sep 01 14:00:30.630489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:30.630489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-VolumesNegativeTest-149179289-project Sep 01 14:00:30.630489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:00:30.630489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:00:30.630489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 219806fd01d14fa58f336ea720f274b1 Sep 01 14:00:30.630489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-VolumesNegativeTest-149179289-project Sep 01 14:00:30.630489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Sep 01 14:00:30.630489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-959626025", "metadata": {"Type": "work"}}} Sep 01 14:00:30.630489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: Sep 01 14:00:30.630489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-959626025', 'metadata': {'Type': 'work'}}}} Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise error Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi '' Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:30.631495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 14:00:30.632829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 14:00:30.633927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 14:00:30.633927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:30.642953 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5b6d600b-78a8-40b4-8188-44a1e4fc40fc tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:30.644654 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-5b6d600b-78a8-40b4-8188-44a1e4fc40fc tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.025574 Sep 01 14:00:30.646224 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 3/3] 10.222.0.61 () {60 vars in 1156 bytes} [Thu Sep 1 14:00:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:00:30.661406 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b5e5cd58-0eec-4d0f-a10b-8c729a4b1643 tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Calling method '.version_select at 0x7f1afe354af0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:31.395597 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-b5e5cd58-0eec-4d0f-a10b-8c729a4b1643 tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] HTTP exception thrown: Volume tempest-invalid-1637587946 could not be found. Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b5e5cd58-0eec-4d0f-a10b-8c729a4b1643 tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Request method failure captured: Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1637587946 HTTP/1.1 Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELr9RaFsD0PQLyIx-7WGY2v5iuzdZ9SgNllUfsCQRk46HEJhM1w_RJ0cXsqx1LCiq54msdDrfFhF5sQxkTzTli9xALVVJEQG20UZcIG17ta9XveOfla_sI5Wa2HkhMk4BYQZ2p6uI4S_MkagEcgAkSGRCieUSoGVbBcRZKlITKM5Vmo Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 421b15cacc7a46388f87a068db634585 Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:00:31.400300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:00:31.410869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/421b15cacc7a46388f87a068db634585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/421b15cacc7a46388f87a068db634585"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/421b15cacc7a46388f87a068db634585"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_421b15cacc7a46388f87a068db634585"}]}] Sep 01 14:00:31.410869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:31.410869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 421b15cacc7a46388f87a068db634585 Sep 01 14:00:31.410869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:31.410869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-VolumesNegativeTest-149179289-project Sep 01 14:00:31.410869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:00:31.410869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:00:31.410869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 219806fd01d14fa58f336ea720f274b1 Sep 01 14:00:31.410869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-VolumesNegativeTest-149179289-project Sep 01 14:00:31.410869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: Sep 01 14:00:31.410869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Volume tempest-invalid-1637587946 could not be found. Sep 01 14:00:31.410869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': 'tempest-invalid-1637587946'} Sep 01 14:00:31.410869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1637587946 could not be found. (HTTP 404) (Request-ID: req-90857043-8626-4cb5-b1fb-b3a6383de81e) Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:31.411994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:00:31.413177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1637587946 could not be found. Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:00:31.414423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1637587946 could not be found. Sep 01 14:00:31.415616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.415616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:31.415616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.415616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.415616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:31.415616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:31.415616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:00:31.415616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:00:31.415616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1637587946 could not be found. Sep 01 14:00:31.415616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.415616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b5e5cd58-0eec-4d0f-a10b-8c729a4b1643 tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Returning 404 to user: Volume tempest-invalid-1637587946 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:31.415616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b5e5cd58-0eec-4d0f-a10b-8c729a4b1643 tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1637587946" status: 404 len: 99 microversion: 2.1 time: 0.750821 Sep 01 14:00:31.415616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 4/4] 10.222.0.61 () {58 vars in 1218 bytes} [Thu Sep 1 14:00:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1637587946 => generated 99 bytes in 753 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 14:00:31.416405 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-435afd62-c551-4775-8448-76e81cfe7f6f tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004660 Sep 01 14:00:31.416405 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 5/5] 10.222.0.61 () {58 vars in 1140 bytes} [Thu Sep 1 14:00:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 01 14:00:31.426202 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-23c1aa0e-49d7-4bc9-ab16-89745175fdb3 tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004056 Sep 01 14:00:31.432747 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 6/6] 10.222.0.61 () {58 vars in 1137 bytes} [Thu Sep 1 14:00:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 01 14:00:31.442359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-edda9db0-8354-4050-9cfe-70da2cf64157 tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Calling method '.version_select at 0x7f1afe1e90d0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:31.559563 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-edda9db0-8354-4050-9cfe-70da2cf64157 tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] HTTP exception thrown: Volume 20ce018a-1dca-4bfb-a87c-748a6544bc41 could not be found. Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-edda9db0-8354-4050-9cfe-70da2cf64157 tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Request method failure captured: Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: DELETE /compute/v2.1/os-volumes/20ce018a-1dca-4bfb-a87c-748a6544bc41 HTTP/1.1 Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELr9RaFsD0PQLyIx-7WGY2v5iuzdZ9SgNllUfsCQRk46HEJhM1w_RJ0cXsqx1LCiq54msdDrfFhF5sQxkTzTli9xALVVJEQG20UZcIG17ta9XveOfla_sI5Wa2HkhMk4BYQZ2p6uI4S_MkagEcgAkSGRCieUSoGVbBcRZKlITKM5Vmo Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 421b15cacc7a46388f87a068db634585 Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:00:31.561665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:00:31.563343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/421b15cacc7a46388f87a068db634585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/421b15cacc7a46388f87a068db634585"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/421b15cacc7a46388f87a068db634585"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_421b15cacc7a46388f87a068db634585"}]}] Sep 01 14:00:31.563343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:31.563343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 421b15cacc7a46388f87a068db634585 Sep 01 14:00:31.563343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:31.563343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-VolumesNegativeTest-149179289-project Sep 01 14:00:31.563343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:00:31.563343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:00:31.563343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 219806fd01d14fa58f336ea720f274b1 Sep 01 14:00:31.563343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-VolumesNegativeTest-149179289-project Sep 01 14:00:31.563343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: Sep 01 14:00:31.563343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Volume 20ce018a-1dca-4bfb-a87c-748a6544bc41 could not be found. Sep 01 14:00:31.563343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '20ce018a-1dca-4bfb-a87c-748a6544bc41'} Sep 01 14:00:31.563343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20ce018a-1dca-4bfb-a87c-748a6544bc41 could not be found. (HTTP 404) (Request-ID: req-20714ba1-3504-4e51-81ca-890ebad7efdb) Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:31.811422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:00:31.820801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20ce018a-1dca-4bfb-a87c-748a6544bc41 could not be found. Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 14:00:31.842945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20ce018a-1dca-4bfb-a87c-748a6544bc41 could not be found. Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20ce018a-1dca-4bfb-a87c-748a6544bc41 could not be found. Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-edda9db0-8354-4050-9cfe-70da2cf64157 tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Returning 404 to user: Volume 20ce018a-1dca-4bfb-a87c-748a6544bc41 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-edda9db0-8354-4050-9cfe-70da2cf64157 tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/20ce018a-1dca-4bfb-a87c-748a6544bc41" status: 404 len: 109 microversion: 2.1 time: 0.127297 Sep 01 14:00:31.844984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 7/7] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 1 14:00:31 2022] DELETE /compute/v2.1/os-volumes/20ce018a-1dca-4bfb-a87c-748a6544bc41 => generated 109 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ba7ea5ff-282f-49a3-b315-c93a8a8a44fe tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Calling method '.version_select at 0x7f1afe1d19d0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-ba7ea5ff-282f-49a3-b315-c93a8a8a44fe tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] HTTP exception thrown: Volume 43ba98bd-d5ee-4736-af48-252f274381ab could not be found. Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ba7ea5ff-282f-49a3-b315-c93a8a8a44fe tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Request method failure captured: Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/os-volumes/43ba98bd-d5ee-4736-af48-252f274381ab HTTP/1.1 Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELr9RaFsD0PQLyIx-7WGY2v5iuzdZ9SgNllUfsCQRk46HEJhM1w_RJ0cXsqx1LCiq54msdDrfFhF5sQxkTzTli9xALVVJEQG20UZcIG17ta9XveOfla_sI5Wa2HkhMk4BYQZ2p6uI4S_MkagEcgAkSGRCieUSoGVbBcRZKlITKM5Vmo Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 421b15cacc7a46388f87a068db634585 Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:00:31.849859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:00:31.857559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/421b15cacc7a46388f87a068db634585"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/421b15cacc7a46388f87a068db634585"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/421b15cacc7a46388f87a068db634585"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_421b15cacc7a46388f87a068db634585"}]}] Sep 01 14:00:31.857559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:31.857559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 421b15cacc7a46388f87a068db634585 Sep 01 14:00:31.857559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-VolumesNegativeTest-149179289 Sep 01 14:00:31.857559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-VolumesNegativeTest-149179289-project Sep 01 14:00:31.857559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:00:31.857559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:00:31.857559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 219806fd01d14fa58f336ea720f274b1 Sep 01 14:00:31.857559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-VolumesNegativeTest-149179289-project Sep 01 14:00:31.857559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: Sep 01 14:00:31.857559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Volume 43ba98bd-d5ee-4736-af48-252f274381ab could not be found. Sep 01 14:00:31.857559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '43ba98bd-d5ee-4736-af48-252f274381ab'} Sep 01 14:00:31.857559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43ba98bd-d5ee-4736-af48-252f274381ab could not be found. (HTTP 404) (Request-ID: req-4ef6d90d-e6c8-4e3b-bea0-de641e3a7f3b) Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:31.859899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:00:31.868671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43ba98bd-d5ee-4736-af48-252f274381ab could not be found. Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 14:00:31.872977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43ba98bd-d5ee-4736-af48-252f274381ab could not be found. Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43ba98bd-d5ee-4736-af48-252f274381ab could not be found. Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ba7ea5ff-282f-49a3-b315-c93a8a8a44fe tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] Returning 404 to user: Volume 43ba98bd-d5ee-4736-af48-252f274381ab could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ba7ea5ff-282f-49a3-b315-c93a8a8a44fe tempest-VolumesNegativeTest-149179289 tempest-VolumesNegativeTest-149179289-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/43ba98bd-d5ee-4736-af48-252f274381ab" status: 404 len: 109 microversion: 2.1 time: 0.082989 Sep 01 14:00:31.878219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 8/8] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:00:31 2022] GET /compute/v2.1/os-volumes/43ba98bd-d5ee-4736-af48-252f274381ab => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:00:32.915596 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-95176932-0b87-410e-b8b5-2cccca5606e9 tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 3.941069 Sep 01 14:00:32.930990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 1/9] 10.222.0.61 () {60 vars in 1156 bytes} [Thu Sep 1 14:00:28 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 3958 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 14:00:32.949992 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9559bc24-3813-416a-9278-0b0ed9270539 tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] Calling method '.version_select at 0x7f1afe3545e0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:33.179336 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9559bc24-3813-416a-9278-0b0ed9270539 tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698" status: 200 len: 351 microversion: 2.1 time: 0.239564 Sep 01 14:00:33.188348 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 9/10] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:00:32 2022] GET /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698 => generated 351 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:34.197746 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-dc982bd1-1bf8-4e88-817f-a66bd82491a8 tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] Calling method '.version_select at 0x7f1afe2650d0>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:34.284393 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-dc982bd1-1bf8-4e88-817f-a66bd82491a8 tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698" status: 200 len: 351 microversion: 2.1 time: 0.091662 Sep 01 14:00:34.291069 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 2/11] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:00:34 2022] GET /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698 => generated 351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:35.298663 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-550c9dd7-c0b7-4993-a719-f82a221edd48 tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] Calling method '.version_select at 0x7f1afe1d1ee0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:35.410454 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-550c9dd7-c0b7-4993-a719-f82a221edd48 tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698" status: 200 len: 352 microversion: 2.1 time: 0.114577 Sep 01 14:00:35.411862 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 10/12] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:00:35 2022] GET /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:35.424886 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5d3b7ab1-1e1b-44bf-908f-27279e92bdf8 tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] Calling method '.version_select at 0x7f1afe265790>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:35.547627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5d3b7ab1-1e1b-44bf-908f-27279e92bdf8 tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698" status: 200 len: 352 microversion: 2.1 time: 0.113561 Sep 01 14:00:35.547627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 3/13] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:00:35 2022] GET /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:00:35.558322 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e995bb21-567a-46f6-9498-848d4f5e46ff tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] Calling method '.version_select at 0x7f1afe1e91f0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:35.869617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e995bb21-567a-46f6-9498-848d4f5e46ff tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698" status: 202 len: 0 microversion: 2.1 time: 0.315580 Sep 01 14:00:35.870276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 11/14] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 1 14:00:35 2022] DELETE /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:00:35.879524 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f9aed96d-2c92-4970-b63a-2a23103e0764 tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] Calling method '.version_select at 0x7f1afe265e50>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:35.967800 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f9aed96d-2c92-4970-b63a-2a23103e0764 tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698" status: 200 len: 351 microversion: 2.1 time: 0.092688 Sep 01 14:00:35.968723 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 4/15] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:00:35 2022] GET /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698 => generated 351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:00:36.994274 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-461332c8-7828-4a89-840b-4343da5bb42e tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] Calling method '.version_select at 0x7f1afe1e9d30>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:37.089104 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-461332c8-7828-4a89-840b-4343da5bb42e tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] HTTP exception thrown: Volume 405019e6-f0c0-4554-b837-64d1499ee698 could not be found. Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-461332c8-7828-4a89-840b-4343da5bb42e tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] Request method failure captured: Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698 HTTP/1.1 Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELr8QFjChEPhUAapckK36oZsxnxp0O9JW0X8JfCHo1J5kW9e4AXa8pC66D2hz6QOQ3pHLZw_iOkiS8NWYJvmkWdoPVmAulwroZ9Lyi1uCKXO4S-iWDKvoqMVuVFYf54g1ehXjJgudzKS7MqQhqfHRaAUTmIGCrwnMnLTUPnUfIyiME4 Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 69c0c03f491744169f699453bbb5ca86 Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-VolumesGetTestJSON-1514534733 Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:00:37.092251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:00:37.093350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/69c0c03f491744169f699453bbb5ca86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/69c0c03f491744169f699453bbb5ca86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/69c0c03f491744169f699453bbb5ca86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_69c0c03f491744169f699453bbb5ca86"}]}] Sep 01 14:00:37.093350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-VolumesGetTestJSON-1514534733 Sep 01 14:00:37.093350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 69c0c03f491744169f699453bbb5ca86 Sep 01 14:00:37.093350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-VolumesGetTestJSON-1514534733 Sep 01 14:00:37.093350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-VolumesGetTestJSON-1514534733-project Sep 01 14:00:37.093350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:00:37.093350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:00:37.093350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: caba7ce953dc442d9f1b6cac52d4ef55 Sep 01 14:00:37.093350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-VolumesGetTestJSON-1514534733-project Sep 01 14:00:37.093350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: Sep 01 14:00:37.093350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Volume 405019e6-f0c0-4554-b837-64d1499ee698 could not be found. Sep 01 14:00:37.093350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '405019e6-f0c0-4554-b837-64d1499ee698'} Sep 01 14:00:37.093350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 405019e6-f0c0-4554-b837-64d1499ee698 could not be found. (HTTP 404) (Request-ID: req-c041fb61-f48a-481a-96a1-4e4be810c40c) Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:37.094004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:00:37.094963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 405019e6-f0c0-4554-b837-64d1499ee698 could not be found. Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 14:00:37.095855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:00:37.096728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 405019e6-f0c0-4554-b837-64d1499ee698 could not be found. Sep 01 14:00:37.096728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:37.096728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:00:37.096728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:37.096728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:00:37.096728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:00:37.096728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:00:37.096728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:00:37.096728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:00:37.096728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 405019e6-f0c0-4554-b837-64d1499ee698 could not be found. Sep 01 14:00:37.096728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:00:37.099448 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-461332c8-7828-4a89-840b-4343da5bb42e tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] Returning 404 to user: Volume 405019e6-f0c0-4554-b837-64d1499ee698 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:00:37.100667 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-461332c8-7828-4a89-840b-4343da5bb42e tempest-VolumesGetTestJSON-1514534733 tempest-VolumesGetTestJSON-1514534733-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698" status: 404 len: 109 microversion: 2.1 time: 0.121599 Sep 01 14:00:37.102492 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 12/16] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:00:36 2022] GET /compute/v2.1/os-volumes/405019e6-f0c0-4554-b837-64d1499ee698 => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:00:46.298972 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1289223280", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "networks": [{"uuid": "04f7ddfc-5d82-4cea-84b8-fb18ad4a984b"}]}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:46.413006 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4b462deb-ce13-46df-9e91-25a65b5ffade tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Action: 'create', calling method: .version_select at 0x7f1afe1e91f0>, body: {"keypair": {"name": "tempest-keypair-1505611958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFV6I07irpzqbjWi8q5dfTavV/wbt0PRrpNbSBMEsuhAQVHTK4ouyZhwuWrYnDJXx8z0VH1bu27YusM1TQ+Tt97hHJY3XR90is/NZY6pz0xHMWS020dp9ZR14/V38Fbkjw=="}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:46.603409 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-4b462deb-ce13-46df-9e91-25a65b5ffade tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Getting quotas for project 8352a8d484e24264a536b8960dab338f. Resources: {'key_pairs'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:00:46.671537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-4b462deb-ce13-46df-9e91-25a65b5ffade tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Getting quotas for user 1943057b69d342d9b45fc02be9f3d5aa and project 8352a8d484e24264a536b8960dab338f. Resources: {'key_pairs'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:00:46.706172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.network.neutron [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] validate_networks() for [('04f7ddfc-5d82-4cea-84b8-fb18ad4a984b', None, None, None, None, None)] {{(pid=127812) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:00:46.974424 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4b462deb-ce13-46df-9e91-25a65b5ffade tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.350655 Sep 01 14:00:46.980449 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 13/17] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 1 14:00:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:00:48.547316 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-92d445c7-4130-43d2-a3d0-8e2a8dab395c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Action: 'create', calling method: .version_select at 0x7f1afe1434c0>, body: {"keypair": {"name": "tempest-keypair-1843613736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+S6Wj5bDEmrFNHp0MqM/9DJuDGQpdv9tAHxELKI/MQSH+TzhIp4y4euLFuHOTmLErB8fZWgJD1p5Yn+zf8pZo4G//M/KJ1ntu790xuixFisxqdS/elw5AE9SUYvYzXvw=="}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:48.606428 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-92d445c7-4130-43d2-a3d0-8e2a8dab395c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for project c19855b809cc43b2925dc3001284baaa. Resources: {'key_pairs'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:00:48.616994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-92d445c7-4130-43d2-a3d0-8e2a8dab395c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for user c0afa15991f14e0ca0d3701d06a89049 and project c19855b809cc43b2925dc3001284baaa. Resources: {'key_pairs'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:00:48.786452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-92d445c7-4130-43d2-a3d0-8e2a8dab395c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.462043 Sep 01 14:00:48.786452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 14/18] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 1 14:00:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:00:49.740985 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Flavor limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:00:49.742178 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Image limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:00:49.742839 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Flavor pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:00:49.743245 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Image pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:00:49.743659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:00:49.778367 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:49.784028 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:49.784028 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:49.784028 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:49.794332 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:49.795105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:49.899858 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Getting quotas for project 1c53449be8e448b09a184ea79278bb2a. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:00:49.923223 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Getting quotas for user a70246b8e8b842129c99827859b90478 and project 1c53449be8e448b09a184ea79278bb2a. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:00:49.949655 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Going to run 1 instances... {{(pid=127812) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:00:49.968995 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:00:50.229406 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d4e6232f-69dd-4267-be86-4a96016b8fb3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Action: 'create', calling method: .version_select at 0x7f1afe0f85e0>, body: {"keypair": {"name": "tempest-keypair-1336841651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJuvEm4ibUrb3PbccDDhO0z1zdasylnMYAFls8Z4OhqAe9knHpC3es/bXq71WXwGZV2fa6U0Rd61LKXGFfUwOCJJJSZUta9Hw6WZbJtLvNMOs3xztH2TQkDTolklcZmTg=="}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:50.242915 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b5245066-d0d8-4d3e-95bb-390b1632547d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.719244 Sep 01 14:00:50.249224 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 5/19] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:00:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 4721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:00:50.257154 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a9d074d9-d45c-478c-a39a-ece419ec4d84 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:50.258174 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a9d074d9-d45c-478c-a39a-ece419ec4d84 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:50.290342 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-d4e6232f-69dd-4267-be86-4a96016b8fb3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Getting quotas for project 7e322f2f7da74039aff258b70af12095. Resources: {'key_pairs'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:00:50.306448 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-d4e6232f-69dd-4267-be86-4a96016b8fb3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Getting quotas for user b77f38582b8842d7a303e8431299191a and project 7e322f2f7da74039aff258b70af12095. Resources: {'key_pairs'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:00:50.431160 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d4e6232f-69dd-4267-be86-4a96016b8fb3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.548879 Sep 01 14:00:50.432212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 15/20] 10.222.0.61 () {62 vars in 1200 bytes} [Thu Sep 1 14:00:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 551 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 14:00:50.479841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a9d074d9-d45c-478c-a39a-ece419ec4d84 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:50.514266 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a9d074d9-d45c-478c-a39a-ece419ec4d84 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1215 microversion: 2.1 time: 0.258635 Sep 01 14:00:50.516485 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 6/21] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:50 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1215 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:00:51.538656 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c910e810-1459-4b58-8d8d-fd38a5ececf3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:51.540311 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c910e810-1459-4b58-8d8d-fd38a5ececf3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:51.715064 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c910e810-1459-4b58-8d8d-fd38a5ececf3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:51.757405 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c910e810-1459-4b58-8d8d-fd38a5ececf3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1215 microversion: 2.1 time: 0.223117 Sep 01 14:00:51.772404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 16/22] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:51 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1215 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:52.786672 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-74c105cc-ec91-4ef7-ae26-6f7f383898b2 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:52.789063 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-74c105cc-ec91-4ef7-ae26-6f7f383898b2 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:53.066279 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-74c105cc-ec91-4ef7-ae26-6f7f383898b2 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:53.076695 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-74c105cc-ec91-4ef7-ae26-6f7f383898b2 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1215 microversion: 2.1 time: 0.297067 Sep 01 14:00:53.081426 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 7/23] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:52 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1215 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:54.119244 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9a5181ba-dd4a-4e79-8112-3764cd14cdc9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:54.121641 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9a5181ba-dd4a-4e79-8112-3764cd14cdc9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:54.130047 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a5181ba-dd4a-4e79-8112-3764cd14cdc9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:54.130874 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a5181ba-dd4a-4e79-8112-3764cd14cdc9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:54.131554 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a5181ba-dd4a-4e79-8112-3764cd14cdc9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:54.132571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a5181ba-dd4a-4e79-8112-3764cd14cdc9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:54.133222 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a5181ba-dd4a-4e79-8112-3764cd14cdc9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:54.133846 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a5181ba-dd4a-4e79-8112-3764cd14cdc9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:54.556125 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9a5181ba-dd4a-4e79-8112-3764cd14cdc9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:54.594053 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9a5181ba-dd4a-4e79-8112-3764cd14cdc9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1211 microversion: 2.1 time: 0.471714 Sep 01 14:00:54.595034 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 17/24] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:54 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1211 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:00:54.855548 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-995031722", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5403c91e-c3bf-4c71-9cf1-2c320c1a9401"}], "security_groups": [{"name": "tempest-securitygroup--1432809006"}], "key_name": "tempest-keypair-1505611958", "user_data": "}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:55.091922 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.network.neutron [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] validate_networks() for [('5403c91e-c3bf-4c71-9cf1-2c320c1a9401', None, None, None, None, None)] {{(pid=127812) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:00:55.624537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-aab1a139-ceb0-4c2b-a62a-97dfbf36fd3b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:55.634631 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-aab1a139-ceb0-4c2b-a62a-97dfbf36fd3b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:55.656167 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aab1a139-ceb0-4c2b-a62a-97dfbf36fd3b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:55.662993 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aab1a139-ceb0-4c2b-a62a-97dfbf36fd3b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:55.665904 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aab1a139-ceb0-4c2b-a62a-97dfbf36fd3b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:55.665904 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aab1a139-ceb0-4c2b-a62a-97dfbf36fd3b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:55.666871 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aab1a139-ceb0-4c2b-a62a-97dfbf36fd3b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:55.667943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aab1a139-ceb0-4c2b-a62a-97dfbf36fd3b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:56.057245 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-aab1a139-ceb0-4c2b-a62a-97dfbf36fd3b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:56.083103 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-aab1a139-ceb0-4c2b-a62a-97dfbf36fd3b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1275 microversion: 2.1 time: 0.465685 Sep 01 14:00:56.096794 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 18/25] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:55 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1275 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:00:56.131097 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1947743722", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ad8c667-b460-46c7-93b9-306c7a679d39"}], "security_groups": [{"name": "tempest-securitygroup--1494068729"}], "key_name": "tempest-keypair-1843613736", "user_data": "}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:56.535119 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Flavor limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:00:56.536394 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Image limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:00:56.537067 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Flavor pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:00:56.537648 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Image pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:00:56.538378 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:00:56.566225 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:56.567289 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:56.568057 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:56.570827 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:56.571667 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:56.573435 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:56.578605 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.network.neutron [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] validate_networks() for [('9ad8c667-b460-46c7-93b9-306c7a679d39', None, None, None, None, None)] {{(pid=127811) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:00:56.619882 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Getting quotas for project 8352a8d484e24264a536b8960dab338f. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:00:56.628822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Getting quotas for user 1943057b69d342d9b45fc02be9f3d5aa and project 8352a8d484e24264a536b8960dab338f. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:00:56.656638 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Going to run 1 instances... {{(pid=127812) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:00:56.662171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:00:56.869409 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ad24f7aa-3390-49ab-8a8b-d4f64437b47d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.015300 Sep 01 14:00:56.872304 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 8/26] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:00:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:00:56.894614 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4ba31aaf-b22f-43a7-9a08-114603403797 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:56.896524 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4ba31aaf-b22f-43a7-9a08-114603403797 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:57.042851 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4ba31aaf-b22f-43a7-9a08-114603403797 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:57.052694 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4ba31aaf-b22f-43a7-9a08-114603403797 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1237 microversion: 2.1 time: 0.172923 Sep 01 14:00:57.053919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 9/27] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:56 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1237 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:00:57.117939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2b5a589c-acc9-4d2f-a4c3-69bc55286a91 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:57.118981 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2b5a589c-acc9-4d2f-a4c3-69bc55286a91 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:57.149723 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2b5a589c-acc9-4d2f-a4c3-69bc55286a91 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:57.151316 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2b5a589c-acc9-4d2f-a4c3-69bc55286a91 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:57.151845 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2b5a589c-acc9-4d2f-a4c3-69bc55286a91 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:57.153598 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2b5a589c-acc9-4d2f-a4c3-69bc55286a91 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:57.154206 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2b5a589c-acc9-4d2f-a4c3-69bc55286a91 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:57.156934 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2b5a589c-acc9-4d2f-a4c3-69bc55286a91 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:57.507274 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2b5a589c-acc9-4d2f-a4c3-69bc55286a91 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:57.526652 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2b5a589c-acc9-4d2f-a4c3-69bc55286a91 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1273 microversion: 2.1 time: 0.412609 Sep 01 14:00:57.527836 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 10/28] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:57 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1273 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:57.535005 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-582276456", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79bb2981-2b84-47d3-9624-36bfa610c42e"}], "security_groups": [{"name": "tempest-securitygroup--202485550"}], "key_name": "tempest-keypair-1336841651", "user_data": "}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:00:58.171344 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.network.neutron [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] validate_networks() for [('79bb2981-2b84-47d3-9624-36bfa610c42e', None, None, None, None, None)] {{(pid=127812) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:00:59.036646 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Flavor limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:00:59.040335 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Image limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:00:59.040919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Flavor pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:00:59.042576 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Image pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:00:59.045031 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:00:59.055536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:59.056254 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:59.056850 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:59.057829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:59.058586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:59.059172 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:59.101181 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for project c19855b809cc43b2925dc3001284baaa. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:00:59.108793 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for user c0afa15991f14e0ca0d3701d06a89049 and project c19855b809cc43b2925dc3001284baaa. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:00:59.124918 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Going to run 1 instances... {{(pid=127811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:00:59.129085 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:00:59.404653 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Flavor limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:00:59.405297 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Image limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:00:59.405814 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Flavor pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:00:59.406313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Image pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:00:59.406626 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:00:59.424436 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-57543ecc-6248-4e64-b7f9-5f60ed7a7666 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.319083 Sep 01 14:00:59.427792 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:59.428606 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:59.435688 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:59.435688 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:59.435688 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:59.435688 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:59.436070 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 19/29] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:00:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 3337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:00:59.476062 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-fdfccce0-0a85-4851-abe9-5018982048b5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:59.477831 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-fdfccce0-0a85-4851-abe9-5018982048b5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:59.498624 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fdfccce0-0a85-4851-abe9-5018982048b5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:59.500860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fdfccce0-0a85-4851-abe9-5018982048b5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:59.500860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fdfccce0-0a85-4851-abe9-5018982048b5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:59.500860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fdfccce0-0a85-4851-abe9-5018982048b5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:59.502322 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fdfccce0-0a85-4851-abe9-5018982048b5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:59.503131 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fdfccce0-0a85-4851-abe9-5018982048b5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:59.579125 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Getting quotas for project 7e322f2f7da74039aff258b70af12095. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:00:59.603531 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Getting quotas for user b77f38582b8842d7a303e8431299191a and project 7e322f2f7da74039aff258b70af12095. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:00:59.618839 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fdfccce0-0a85-4851-abe9-5018982048b5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:00:59.630927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-fdfccce0-0a85-4851-abe9-5018982048b5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1241 microversion: 2.1 time: 0.194213 Sep 01 14:00:59.632158 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 20/30] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:59 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1241 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:00:59.657142 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2d028564-3b2a-42c2-bf03-be2ad7fc8b9e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:00:59.660933 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2d028564-3b2a-42c2-bf03-be2ad7fc8b9e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:00:59.668677 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Going to run 1 instances... {{(pid=127812) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:00:59.695083 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:00:59.703771 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d028564-3b2a-42c2-bf03-be2ad7fc8b9e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:59.705581 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d028564-3b2a-42c2-bf03-be2ad7fc8b9e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:59.709154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d028564-3b2a-42c2-bf03-be2ad7fc8b9e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:59.713829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d028564-3b2a-42c2-bf03-be2ad7fc8b9e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:00:59.715433 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d028564-3b2a-42c2-bf03-be2ad7fc8b9e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:00:59.717665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d028564-3b2a-42c2-bf03-be2ad7fc8b9e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:00:59.976055 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-47f46d41-458f-49ae-ae56-2a8b26443b16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.446470 Sep 01 14:00:59.987744 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 11/31] 10.222.0.61 () {62 vars in 1188 bytes} [Thu Sep 1 14:00:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 2457 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 14:01:00.001791 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f412201a-71ef-498b-8a6c-568280bca156 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:00.002450 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f412201a-71ef-498b-8a6c-568280bca156 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:00.228734 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f412201a-71ef-498b-8a6c-568280bca156 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:00.244050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f412201a-71ef-498b-8a6c-568280bca156 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1242 microversion: 2.1 time: 0.255127 Sep 01 14:01:00.245397 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 12/32] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:59 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1242 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:00.249292 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2d028564-3b2a-42c2-bf03-be2ad7fc8b9e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:00.266026 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2d028564-3b2a-42c2-bf03-be2ad7fc8b9e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.632364 Sep 01 14:01:00.267039 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 21/33] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:00:59 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:00.275088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d570ea50-b59e-42f0-80e2-5908deaef1b4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:00.275807 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d570ea50-b59e-42f0-80e2-5908deaef1b4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:00.402164 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d570ea50-b59e-42f0-80e2-5908deaef1b4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:00.410890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d570ea50-b59e-42f0-80e2-5908deaef1b4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:00.413314 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d570ea50-b59e-42f0-80e2-5908deaef1b4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:00.414809 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d570ea50-b59e-42f0-80e2-5908deaef1b4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1281 microversion: 2.20 time: 0.168244 Sep 01 14:01:00.431459 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 13/34] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:00 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1281 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:00.664696 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e8e5f727-0325-4f8d-9ffb-0c599304ce82 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:00.665566 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e8e5f727-0325-4f8d-9ffb-0c599304ce82 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:00.686171 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e8e5f727-0325-4f8d-9ffb-0c599304ce82 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:00.688474 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e8e5f727-0325-4f8d-9ffb-0c599304ce82 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:00.689102 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e8e5f727-0325-4f8d-9ffb-0c599304ce82 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:00.691557 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e8e5f727-0325-4f8d-9ffb-0c599304ce82 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:00.698332 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e8e5f727-0325-4f8d-9ffb-0c599304ce82 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:00.698332 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e8e5f727-0325-4f8d-9ffb-0c599304ce82 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:00.894716 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e8e5f727-0325-4f8d-9ffb-0c599304ce82 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:00.905081 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e8e5f727-0325-4f8d-9ffb-0c599304ce82 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1233 microversion: 2.1 time: 0.250885 Sep 01 14:01:00.925903 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 22/35] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:00 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1233 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:01.274192 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6b0375b7-d9fd-4913-97e0-428a554f59f4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:01.275065 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-6b0375b7-d9fd-4913-97e0-428a554f59f4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:01.300770 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-571889a6-90cc-41fc-9ab9-47a3597d468c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:01.302323 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-571889a6-90cc-41fc-9ab9-47a3597d468c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:01.326998 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-571889a6-90cc-41fc-9ab9-47a3597d468c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:01.329934 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-571889a6-90cc-41fc-9ab9-47a3597d468c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:01.330875 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-571889a6-90cc-41fc-9ab9-47a3597d468c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:01.336391 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-571889a6-90cc-41fc-9ab9-47a3597d468c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:01.336391 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-571889a6-90cc-41fc-9ab9-47a3597d468c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:01.336391 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-571889a6-90cc-41fc-9ab9-47a3597d468c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:01.404573 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-6b0375b7-d9fd-4913-97e0-428a554f59f4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:01.416743 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6b0375b7-d9fd-4913-97e0-428a554f59f4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1242 microversion: 2.1 time: 0.146221 Sep 01 14:01:01.418685 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 14/36] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:01 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1242 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:01.441047 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9df97837-12d0-49da-9e55-a86e4b0ac907 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:01.441740 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9df97837-12d0-49da-9e55-a86e4b0ac907 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:01.693462 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9df97837-12d0-49da-9e55-a86e4b0ac907 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:01.738874 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9df97837-12d0-49da-9e55-a86e4b0ac907 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:01.752758 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9df97837-12d0-49da-9e55-a86e4b0ac907 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:01.753235 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9df97837-12d0-49da-9e55-a86e4b0ac907 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1281 microversion: 2.20 time: 0.316680 Sep 01 14:01:01.755380 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 15/37] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:01 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1281 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:01:01.889570 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-571889a6-90cc-41fc-9ab9-47a3597d468c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:01.902299 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-571889a6-90cc-41fc-9ab9-47a3597d468c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.605459 Sep 01 14:01:01.902893 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 23/38] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:01 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:01.931183 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c0089e2b-6461-4a11-857a-1b54566ba69f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:01.932876 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c0089e2b-6461-4a11-857a-1b54566ba69f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:01.965637 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c0089e2b-6461-4a11-857a-1b54566ba69f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:01.966368 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c0089e2b-6461-4a11-857a-1b54566ba69f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:01.968128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c0089e2b-6461-4a11-857a-1b54566ba69f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:01.970732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c0089e2b-6461-4a11-857a-1b54566ba69f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:01.971448 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c0089e2b-6461-4a11-857a-1b54566ba69f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:01.972372 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c0089e2b-6461-4a11-857a-1b54566ba69f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:02.196921 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c0089e2b-6461-4a11-857a-1b54566ba69f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:02.216054 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c0089e2b-6461-4a11-857a-1b54566ba69f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1289 microversion: 2.1 time: 0.287493 Sep 01 14:01:02.216054 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 16/39] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:01 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1289 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:02.418102 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-b679751c-925c-4c42-a5bb-89c9400d7362 req-78c30f51-edbc-489f-9f72-4a006aa52c55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2cd0f94-a988-4e95-8369-9fb5fa9e84c7", "tag": "f3195e75-0686-4b3d-b13d-6bc016fcbc75"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:02.444493 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2009b5d5-eac3-44b4-b64c-239c0cfe41a1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:02.446051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2009b5d5-eac3-44b4-b64c-239c0cfe41a1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:02.450446 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-b679751c-925c-4c42-a5bb-89c9400d7362 req-78c30f51-edbc-489f-9f72-4a006aa52c55 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:02.451211 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-b679751c-925c-4c42-a5bb-89c9400d7362 req-78c30f51-edbc-489f-9f72-4a006aa52c55 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:02.457128 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-b679751c-925c-4c42-a5bb-89c9400d7362 req-78c30f51-edbc-489f-9f72-4a006aa52c55 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:02.459625 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2009b5d5-eac3-44b4-b64c-239c0cfe41a1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:02.464445 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2009b5d5-eac3-44b4-b64c-239c0cfe41a1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:02.467289 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2009b5d5-eac3-44b4-b64c-239c0cfe41a1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:02.468101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2009b5d5-eac3-44b4-b64c-239c0cfe41a1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:02.471495 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2009b5d5-eac3-44b4-b64c-239c0cfe41a1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:02.471956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2009b5d5-eac3-44b4-b64c-239c0cfe41a1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:02.547980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-b679751c-925c-4c42-a5bb-89c9400d7362 req-78c30f51-edbc-489f-9f72-4a006aa52c55 service nova] Creating event network-changed:f3195e75-0686-4b3d-b13d-6bc016fcbc75 for instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 on hv-cinder-85221 Sep 01 14:01:02.548544 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-b679751c-925c-4c42-a5bb-89c9400d7362 req-78c30f51-edbc-489f-9f72-4a006aa52c55 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127811) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 14:01:02.548988 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-b679751c-925c-4c42-a5bb-89c9400d7362 req-78c30f51-edbc-489f-9f72-4a006aa52c55 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127811) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 14:01:02.550134 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-44d4754e-df86-407d-acef-012f31235f10 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:02.551774 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-44d4754e-df86-407d-acef-012f31235f10 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:02.552252 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-44d4754e-df86-407d-acef-012f31235f10 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:02.553022 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-44d4754e-df86-407d-acef-012f31235f10 None None] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:02.556916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-44d4754e-df86-407d-acef-012f31235f10 None None] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:02.557960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-44d4754e-df86-407d-acef-012f31235f10 None None] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:02.580591 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.compute.rpcapi [None req-44d4754e-df86-407d-acef-012f31235f10 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 14:01:02.584612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-44d4754e-df86-407d-acef-012f31235f10 None None] Releasing lock "compute-rpcapi-router" {{(pid=127811) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 14:01:02.626560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-44d4754e-df86-407d-acef-012f31235f10 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.387614 Sep 01 14:01:02.629606 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 24/40] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:02.781130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4412b9ab-d1df-4dc8-a974-3adfea8cad24 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:02.781130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4412b9ab-d1df-4dc8-a974-3adfea8cad24 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:02.790684 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4412b9ab-d1df-4dc8-a974-3adfea8cad24 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:02.792742 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4412b9ab-d1df-4dc8-a974-3adfea8cad24 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:02.793794 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4412b9ab-d1df-4dc8-a974-3adfea8cad24 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:02.794691 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4412b9ab-d1df-4dc8-a974-3adfea8cad24 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:02.795781 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4412b9ab-d1df-4dc8-a974-3adfea8cad24 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:02.796919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4412b9ab-d1df-4dc8-a974-3adfea8cad24 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:02.797422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2009b5d5-eac3-44b4-b64c-239c0cfe41a1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:02.808089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2009b5d5-eac3-44b4-b64c-239c0cfe41a1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1246 microversion: 2.1 time: 0.367934 Sep 01 14:01:02.811535 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 17/41] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:02 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1246 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:02.929876 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4bec2f0d-3049-4f65-8b83-f644e8ebfcca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:02.930712 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4bec2f0d-3049-4f65-8b83-f644e8ebfcca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:02.966089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4bec2f0d-3049-4f65-8b83-f644e8ebfcca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:02.969100 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4bec2f0d-3049-4f65-8b83-f644e8ebfcca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:02.974552 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4bec2f0d-3049-4f65-8b83-f644e8ebfcca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:02.974552 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4bec2f0d-3049-4f65-8b83-f644e8ebfcca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:02.974552 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4bec2f0d-3049-4f65-8b83-f644e8ebfcca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:02.974552 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4bec2f0d-3049-4f65-8b83-f644e8ebfcca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:03.117100 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4412b9ab-d1df-4dc8-a974-3adfea8cad24 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:03.152979 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4412b9ab-d1df-4dc8-a974-3adfea8cad24 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:03.154926 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4412b9ab-d1df-4dc8-a974-3adfea8cad24 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:03.155959 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4412b9ab-d1df-4dc8-a974-3adfea8cad24 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1285 microversion: 2.20 time: 0.381643 Sep 01 14:01:03.156511 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 25/42] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:02 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1285 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:03.238783 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7a65a144-08c2-49ba-ad04-4e7b89555ab0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:03.240239 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7a65a144-08c2-49ba-ad04-4e7b89555ab0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:03.252904 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7a65a144-08c2-49ba-ad04-4e7b89555ab0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:03.253687 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7a65a144-08c2-49ba-ad04-4e7b89555ab0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:03.254496 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7a65a144-08c2-49ba-ad04-4e7b89555ab0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:03.256002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7a65a144-08c2-49ba-ad04-4e7b89555ab0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:03.257694 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7a65a144-08c2-49ba-ad04-4e7b89555ab0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:03.260756 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7a65a144-08c2-49ba-ad04-4e7b89555ab0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:03.581319 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7a65a144-08c2-49ba-ad04-4e7b89555ab0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:03.595462 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7a65a144-08c2-49ba-ad04-4e7b89555ab0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1297 microversion: 2.1 time: 0.359856 Sep 01 14:01:03.598887 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 26/43] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:03 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1297 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:03.826153 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4bec2f0d-3049-4f65-8b83-f644e8ebfcca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:03.833659 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-90a76ee6-506d-47b7-b5ed-ca484bd58b94 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:03.835069 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-90a76ee6-506d-47b7-b5ed-ca484bd58b94 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:03.838777 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4bec2f0d-3049-4f65-8b83-f644e8ebfcca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.916184 Sep 01 14:01:03.841877 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 18/44] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:02 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:03.843343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-90a76ee6-506d-47b7-b5ed-ca484bd58b94 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:03.843840 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-90a76ee6-506d-47b7-b5ed-ca484bd58b94 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:03.844268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-90a76ee6-506d-47b7-b5ed-ca484bd58b94 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:03.845150 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-90a76ee6-506d-47b7-b5ed-ca484bd58b94 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:03.845606 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-90a76ee6-506d-47b7-b5ed-ca484bd58b94 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:03.846050 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-90a76ee6-506d-47b7-b5ed-ca484bd58b94 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:03.934899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-90a76ee6-506d-47b7-b5ed-ca484bd58b94 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:03.943592 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-90a76ee6-506d-47b7-b5ed-ca484bd58b94 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1238 microversion: 2.1 time: 0.115821 Sep 01 14:01:03.944623 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 27/45] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:03 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1238 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:04.185063 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3d406b78-4dc5-41c1-9e9c-693f80cfe3b5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:04.185840 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3d406b78-4dc5-41c1-9e9c-693f80cfe3b5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:04.210550 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3d406b78-4dc5-41c1-9e9c-693f80cfe3b5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:04.224448 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3d406b78-4dc5-41c1-9e9c-693f80cfe3b5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:04.225017 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3d406b78-4dc5-41c1-9e9c-693f80cfe3b5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:04.227571 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3d406b78-4dc5-41c1-9e9c-693f80cfe3b5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:04.231487 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3d406b78-4dc5-41c1-9e9c-693f80cfe3b5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:04.232049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3d406b78-4dc5-41c1-9e9c-693f80cfe3b5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:04.510955 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3d406b78-4dc5-41c1-9e9c-693f80cfe3b5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:04.532185 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3d406b78-4dc5-41c1-9e9c-693f80cfe3b5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:04.539793 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3d406b78-4dc5-41c1-9e9c-693f80cfe3b5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:04.542280 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3d406b78-4dc5-41c1-9e9c-693f80cfe3b5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1333 microversion: 2.20 time: 0.362959 Sep 01 14:01:04.549255 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 19/46] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:04 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1333 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:04.627461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-36dcb337-8313-4a10-a4e4-39c34d4bef30 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:04.628397 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-36dcb337-8313-4a10-a4e4-39c34d4bef30 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:04.635554 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36dcb337-8313-4a10-a4e4-39c34d4bef30 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:04.636481 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36dcb337-8313-4a10-a4e4-39c34d4bef30 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:04.637063 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36dcb337-8313-4a10-a4e4-39c34d4bef30 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:04.638299 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36dcb337-8313-4a10-a4e4-39c34d4bef30 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:04.638902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36dcb337-8313-4a10-a4e4-39c34d4bef30 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:04.639501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36dcb337-8313-4a10-a4e4-39c34d4bef30 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:04.740801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-36dcb337-8313-4a10-a4e4-39c34d4bef30 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:04.749907 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-36dcb337-8313-4a10-a4e4-39c34d4bef30 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1295 microversion: 2.1 time: 0.126481 Sep 01 14:01:04.751377 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 28/47] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:04 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1295 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:04.862045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a06b5ab0-0257-4da6-8a52-8085ff97c2f3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:04.863447 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a06b5ab0-0257-4da6-8a52-8085ff97c2f3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:04.876130 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a06b5ab0-0257-4da6-8a52-8085ff97c2f3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:04.879139 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a06b5ab0-0257-4da6-8a52-8085ff97c2f3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:04.879964 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a06b5ab0-0257-4da6-8a52-8085ff97c2f3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:04.881398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a06b5ab0-0257-4da6-8a52-8085ff97c2f3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:04.882088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a06b5ab0-0257-4da6-8a52-8085ff97c2f3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:04.883937 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a06b5ab0-0257-4da6-8a52-8085ff97c2f3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:04.965702 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-6e8d4461-1ee4-45a2-b267-507aa5533974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:04.976872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-6e8d4461-1ee4-45a2-b267-507aa5533974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:04.976872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6e8d4461-1ee4-45a2-b267-507aa5533974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:04.976872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6e8d4461-1ee4-45a2-b267-507aa5533974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:04.976872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6e8d4461-1ee4-45a2-b267-507aa5533974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:04.977256 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6e8d4461-1ee4-45a2-b267-507aa5533974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:04.977256 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6e8d4461-1ee4-45a2-b267-507aa5533974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:04.977256 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6e8d4461-1ee4-45a2-b267-507aa5533974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:05.118052 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-6e8d4461-1ee4-45a2-b267-507aa5533974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:05.130481 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-6e8d4461-1ee4-45a2-b267-507aa5533974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1294 microversion: 2.1 time: 0.169769 Sep 01 14:01:05.131493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 29/48] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:04 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1294 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:05.268008 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a06b5ab0-0257-4da6-8a52-8085ff97c2f3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:05.356031 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a06b5ab0-0257-4da6-8a52-8085ff97c2f3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.482679 Sep 01 14:01:05.361747 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 20/49] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:04 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:05.566547 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-77345874-bb32-446b-9814-531768a642b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:05.567159 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-77345874-bb32-446b-9814-531768a642b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:05.592061 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-77345874-bb32-446b-9814-531768a642b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:05.594203 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-77345874-bb32-446b-9814-531768a642b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:05.601872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-77345874-bb32-446b-9814-531768a642b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:05.601872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-77345874-bb32-446b-9814-531768a642b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:05.601872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-77345874-bb32-446b-9814-531768a642b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:05.601872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-77345874-bb32-446b-9814-531768a642b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:05.749677 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-77345874-bb32-446b-9814-531768a642b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:05.759814 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-77345874-bb32-446b-9814-531768a642b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:05.773070 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-bb8f56b8-a60f-47e3-8700-fc0af5f51d46 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:05.775218 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-77345874-bb32-446b-9814-531768a642b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:05.775338 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-bb8f56b8-a60f-47e3-8700-fc0af5f51d46 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:05.775421 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-77345874-bb32-446b-9814-531768a642b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1341 microversion: 2.20 time: 0.211968 Sep 01 14:01:05.776425 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 30/50] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:05 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1341 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:05.785216 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bb8f56b8-a60f-47e3-8700-fc0af5f51d46 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:05.788711 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bb8f56b8-a60f-47e3-8700-fc0af5f51d46 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:05.789543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bb8f56b8-a60f-47e3-8700-fc0af5f51d46 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:05.790596 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bb8f56b8-a60f-47e3-8700-fc0af5f51d46 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:05.792661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bb8f56b8-a60f-47e3-8700-fc0af5f51d46 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:05.793959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bb8f56b8-a60f-47e3-8700-fc0af5f51d46 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:05.895574 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-bb8f56b8-a60f-47e3-8700-fc0af5f51d46 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:05.907911 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-bb8f56b8-a60f-47e3-8700-fc0af5f51d46 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1295 microversion: 2.1 time: 0.139313 Sep 01 14:01:05.908674 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 21/51] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:05 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1295 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:06.162124 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-fda94db8-f182-410a-8624-644d91b50a89 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:06.162124 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-fda94db8-f182-410a-8624-644d91b50a89 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:06.168467 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fda94db8-f182-410a-8624-644d91b50a89 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:06.169543 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fda94db8-f182-410a-8624-644d91b50a89 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:06.170820 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fda94db8-f182-410a-8624-644d91b50a89 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:06.172223 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fda94db8-f182-410a-8624-644d91b50a89 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:06.173270 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fda94db8-f182-410a-8624-644d91b50a89 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:06.174292 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fda94db8-f182-410a-8624-644d91b50a89 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:06.303015 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fda94db8-f182-410a-8624-644d91b50a89 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:06.336117 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-fda94db8-f182-410a-8624-644d91b50a89 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1294 microversion: 2.1 time: 0.183160 Sep 01 14:01:06.338769 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 31/52] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:06 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1294 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:06.363421 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-939a08a2-a6c9-478f-ae4e-bc027ca25be9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:06.364047 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-939a08a2-a6c9-478f-ae4e-bc027ca25be9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:06.370657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-939a08a2-a6c9-478f-ae4e-bc027ca25be9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:06.371781 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-939a08a2-a6c9-478f-ae4e-bc027ca25be9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:06.373093 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-939a08a2-a6c9-478f-ae4e-bc027ca25be9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:06.374069 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-939a08a2-a6c9-478f-ae4e-bc027ca25be9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:06.374517 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-939a08a2-a6c9-478f-ae4e-bc027ca25be9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:06.374983 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-939a08a2-a6c9-478f-ae4e-bc027ca25be9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:06.545234 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-939a08a2-a6c9-478f-ae4e-bc027ca25be9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:06.569152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-939a08a2-a6c9-478f-ae4e-bc027ca25be9 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.209683 Sep 01 14:01:06.571658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 22/53] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:06 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:06.802432 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2a86339b-f15a-4bc5-9186-219c4433df0b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:06.804167 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2a86339b-f15a-4bc5-9186-219c4433df0b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:06.814261 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2a86339b-f15a-4bc5-9186-219c4433df0b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:06.815414 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2a86339b-f15a-4bc5-9186-219c4433df0b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:06.817800 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2a86339b-f15a-4bc5-9186-219c4433df0b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:06.817800 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2a86339b-f15a-4bc5-9186-219c4433df0b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:06.817800 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2a86339b-f15a-4bc5-9186-219c4433df0b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:06.818321 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2a86339b-f15a-4bc5-9186-219c4433df0b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:06.945844 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a239b30d-34c4-42b0-bb17-8b7454f1ed8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:06.946968 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a239b30d-34c4-42b0-bb17-8b7454f1ed8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:06.966541 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a239b30d-34c4-42b0-bb17-8b7454f1ed8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:06.966541 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a239b30d-34c4-42b0-bb17-8b7454f1ed8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:06.966541 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a239b30d-34c4-42b0-bb17-8b7454f1ed8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:06.966541 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a239b30d-34c4-42b0-bb17-8b7454f1ed8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:06.967200 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a239b30d-34c4-42b0-bb17-8b7454f1ed8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:06.979592 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2a86339b-f15a-4bc5-9186-219c4433df0b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:06.990555 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a239b30d-34c4-42b0-bb17-8b7454f1ed8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:06.993680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2a86339b-f15a-4bc5-9186-219c4433df0b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:06.996035 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2a86339b-f15a-4bc5-9186-219c4433df0b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:06.997452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2a86339b-f15a-4bc5-9186-219c4433df0b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1341 microversion: 2.20 time: 0.200821 Sep 01 14:01:07.000816 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 32/54] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:06 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1341 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:07.170954 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a239b30d-34c4-42b0-bb17-8b7454f1ed8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:07.178655 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a239b30d-34c4-42b0-bb17-8b7454f1ed8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.243208 Sep 01 14:01:07.179210 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 23/55] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:06 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:07.360906 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d03b2a08-c286-4311-a4fb-9d53187550bc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:07.361641 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d03b2a08-c286-4311-a4fb-9d53187550bc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:07.378221 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d03b2a08-c286-4311-a4fb-9d53187550bc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:07.380637 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d03b2a08-c286-4311-a4fb-9d53187550bc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:07.380637 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d03b2a08-c286-4311-a4fb-9d53187550bc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:07.380637 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d03b2a08-c286-4311-a4fb-9d53187550bc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:07.380637 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d03b2a08-c286-4311-a4fb-9d53187550bc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:07.381608 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d03b2a08-c286-4311-a4fb-9d53187550bc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:07.481679 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d03b2a08-c286-4311-a4fb-9d53187550bc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:07.490547 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d03b2a08-c286-4311-a4fb-9d53187550bc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1294 microversion: 2.1 time: 0.134680 Sep 01 14:01:07.506154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 33/56] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:07 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1294 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:07.595455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-03ae5127-7923-432a-9422-729f45757bbf tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:07.596160 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-03ae5127-7923-432a-9422-729f45757bbf tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:07.602456 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:07.605219 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-03ae5127-7923-432a-9422-729f45757bbf tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:07.605956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-03ae5127-7923-432a-9422-729f45757bbf tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:07.606559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-03ae5127-7923-432a-9422-729f45757bbf tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:07.607256 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-03ae5127-7923-432a-9422-729f45757bbf tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:07.607703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-03ae5127-7923-432a-9422-729f45757bbf tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:07.608146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-03ae5127-7923-432a-9422-729f45757bbf tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:07.772702 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-03ae5127-7923-432a-9422-729f45757bbf tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:07.782562 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-03ae5127-7923-432a-9422-729f45757bbf tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.191976 Sep 01 14:01:07.791147 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 24/57] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:07 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:08.020806 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1ce99cbe-e66d-44f3-b6cd-524ec435c380 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:08.024236 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1ce99cbe-e66d-44f3-b6cd-524ec435c380 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:08.040710 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ce99cbe-e66d-44f3-b6cd-524ec435c380 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:08.040710 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ce99cbe-e66d-44f3-b6cd-524ec435c380 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:08.040710 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ce99cbe-e66d-44f3-b6cd-524ec435c380 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:08.040710 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ce99cbe-e66d-44f3-b6cd-524ec435c380 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:08.041010 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ce99cbe-e66d-44f3-b6cd-524ec435c380 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:08.041010 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ce99cbe-e66d-44f3-b6cd-524ec435c380 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:08.079345 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:08.176353 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1ce99cbe-e66d-44f3-b6cd-524ec435c380 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:08.187937 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1ce99cbe-e66d-44f3-b6cd-524ec435c380 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:08.190033 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1ce99cbe-e66d-44f3-b6cd-524ec435c380 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:08.199333 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1ce99cbe-e66d-44f3-b6cd-524ec435c380 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1341 microversion: 2.20 time: 0.182581 Sep 01 14:01:08.205835 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-fc0f3220-9f1b-48f7-8fd1-f25a83ab717e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:08.205835 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fc0f3220-9f1b-48f7-8fd1-f25a83ab717e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:08.213875 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 34/58] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:08 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1341 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:08.216521 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fc0f3220-9f1b-48f7-8fd1-f25a83ab717e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:08.217243 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fc0f3220-9f1b-48f7-8fd1-f25a83ab717e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:08.218075 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fc0f3220-9f1b-48f7-8fd1-f25a83ab717e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:08.224171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fc0f3220-9f1b-48f7-8fd1-f25a83ab717e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:08.224171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fc0f3220-9f1b-48f7-8fd1-f25a83ab717e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:08.228282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fc0f3220-9f1b-48f7-8fd1-f25a83ab717e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:08.425759 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fc0f3220-9f1b-48f7-8fd1-f25a83ab717e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:08.442391 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-fc0f3220-9f1b-48f7-8fd1-f25a83ab717e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.246161 Sep 01 14:01:08.458240 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 25/59] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:08 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:08.514498 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3d538a2f-323c-4eab-a328-04ed4996691b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:08.515431 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3d538a2f-323c-4eab-a328-04ed4996691b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:08.534639 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3d538a2f-323c-4eab-a328-04ed4996691b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:08.536603 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3d538a2f-323c-4eab-a328-04ed4996691b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:08.537446 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3d538a2f-323c-4eab-a328-04ed4996691b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:08.538851 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3d538a2f-323c-4eab-a328-04ed4996691b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:08.542536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3d538a2f-323c-4eab-a328-04ed4996691b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:08.543238 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3d538a2f-323c-4eab-a328-04ed4996691b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:08.645155 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3d538a2f-323c-4eab-a328-04ed4996691b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:08.654970 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3d538a2f-323c-4eab-a328-04ed4996691b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1294 microversion: 2.1 time: 0.145195 Sep 01 14:01:08.655561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 35/60] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:08 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1294 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:08.804746 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c90f6c27-9711-4dcd-8a5d-227ef1a2ed45 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:08.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c90f6c27-9711-4dcd-8a5d-227ef1a2ed45 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:08.812354 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c90f6c27-9711-4dcd-8a5d-227ef1a2ed45 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:08.812848 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c90f6c27-9711-4dcd-8a5d-227ef1a2ed45 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:08.813305 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c90f6c27-9711-4dcd-8a5d-227ef1a2ed45 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:08.814021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c90f6c27-9711-4dcd-8a5d-227ef1a2ed45 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:08.814622 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c90f6c27-9711-4dcd-8a5d-227ef1a2ed45 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:08.815075 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c90f6c27-9711-4dcd-8a5d-227ef1a2ed45 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:08.979008 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c90f6c27-9711-4dcd-8a5d-227ef1a2ed45 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:08.988400 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c90f6c27-9711-4dcd-8a5d-227ef1a2ed45 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.187361 Sep 01 14:01:08.988976 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 26/61] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:08 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:09.223846 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-94001eb2-ab9e-44c8-b3ad-89d18d3a445f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:09.224464 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-94001eb2-ab9e-44c8-b3ad-89d18d3a445f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:09.228071 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=20 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:09.232345 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-94001eb2-ab9e-44c8-b3ad-89d18d3a445f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:09.232876 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-94001eb2-ab9e-44c8-b3ad-89d18d3a445f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:09.233315 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-94001eb2-ab9e-44c8-b3ad-89d18d3a445f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:09.234049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-94001eb2-ab9e-44c8-b3ad-89d18d3a445f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:09.234507 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-94001eb2-ab9e-44c8-b3ad-89d18d3a445f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:09.234937 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-94001eb2-ab9e-44c8-b3ad-89d18d3a445f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:09.304991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-94001eb2-ab9e-44c8-b3ad-89d18d3a445f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:09.316650 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-94001eb2-ab9e-44c8-b3ad-89d18d3a445f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:09.318484 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-94001eb2-ab9e-44c8-b3ad-89d18d3a445f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:09.320060 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-94001eb2-ab9e-44c8-b3ad-89d18d3a445f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1341 microversion: 2.20 time: 0.100275 Sep 01 14:01:09.321536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 36/62] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:09 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1341 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:09.464641 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3251f358-74a3-47e2-a401-0ae2a22c598a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:09.465320 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3251f358-74a3-47e2-a401-0ae2a22c598a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:09.477806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3251f358-74a3-47e2-a401-0ae2a22c598a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:09.478346 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3251f358-74a3-47e2-a401-0ae2a22c598a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:09.478821 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3251f358-74a3-47e2-a401-0ae2a22c598a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:09.479544 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3251f358-74a3-47e2-a401-0ae2a22c598a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:09.479999 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3251f358-74a3-47e2-a401-0ae2a22c598a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:09.480416 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3251f358-74a3-47e2-a401-0ae2a22c598a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:09.514724 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=6 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:09.631251 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3251f358-74a3-47e2-a401-0ae2a22c598a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:09.764778 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3251f358-74a3-47e2-a401-0ae2a22c598a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.180478 Sep 01 14:01:09.764778 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 27/63] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:09 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:09.765642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-74d82315-7b34-4dd2-a2d8-3e08ff9c2397 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:09.765642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-74d82315-7b34-4dd2-a2d8-3e08ff9c2397 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:09.765642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-74d82315-7b34-4dd2-a2d8-3e08ff9c2397 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:09.765642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-74d82315-7b34-4dd2-a2d8-3e08ff9c2397 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:09.766014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-74d82315-7b34-4dd2-a2d8-3e08ff9c2397 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:09.766014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-74d82315-7b34-4dd2-a2d8-3e08ff9c2397 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:09.766014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-74d82315-7b34-4dd2-a2d8-3e08ff9c2397 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:09.766014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-74d82315-7b34-4dd2-a2d8-3e08ff9c2397 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:09.766404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-74d82315-7b34-4dd2-a2d8-3e08ff9c2397 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:09.766404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-74d82315-7b34-4dd2-a2d8-3e08ff9c2397 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1294 microversion: 2.1 time: 0.086210 Sep 01 14:01:09.766404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 37/64] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:09 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:10.017682 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8b4e91ce-c1dc-4b88-8bd5-1be241e2495f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:10.018518 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8b4e91ce-c1dc-4b88-8bd5-1be241e2495f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:10.025903 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8b4e91ce-c1dc-4b88-8bd5-1be241e2495f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:10.026578 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8b4e91ce-c1dc-4b88-8bd5-1be241e2495f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:10.027053 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8b4e91ce-c1dc-4b88-8bd5-1be241e2495f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:10.027791 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8b4e91ce-c1dc-4b88-8bd5-1be241e2495f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:10.028247 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8b4e91ce-c1dc-4b88-8bd5-1be241e2495f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:10.028669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8b4e91ce-c1dc-4b88-8bd5-1be241e2495f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:10.280988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8b4e91ce-c1dc-4b88-8bd5-1be241e2495f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:10.290232 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8b4e91ce-c1dc-4b88-8bd5-1be241e2495f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.277278 Sep 01 14:01:10.312089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 28/65] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:10 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:10.344541 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-6589f32e-d87b-499a-91be-5642fb305d8f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:10.345641 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-6589f32e-d87b-499a-91be-5642fb305d8f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:10.356453 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:10.360379 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6589f32e-d87b-499a-91be-5642fb305d8f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:10.360959 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6589f32e-d87b-499a-91be-5642fb305d8f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:10.361651 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6589f32e-d87b-499a-91be-5642fb305d8f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:10.362940 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6589f32e-d87b-499a-91be-5642fb305d8f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:10.363546 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6589f32e-d87b-499a-91be-5642fb305d8f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:10.364210 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6589f32e-d87b-499a-91be-5642fb305d8f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:10.592035 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-6589f32e-d87b-499a-91be-5642fb305d8f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:10.596378 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-6589f32e-d87b-499a-91be-5642fb305d8f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:10.597986 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-6589f32e-d87b-499a-91be-5642fb305d8f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:10.599203 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-6589f32e-d87b-499a-91be-5642fb305d8f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1341 microversion: 2.20 time: 0.259219 Sep 01 14:01:10.599868 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 38/66] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:10 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1341 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:10.773326 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a32fe1fa-52ad-4570-a626-4989adad5652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:10.774981 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a32fe1fa-52ad-4570-a626-4989adad5652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:10.782034 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a32fe1fa-52ad-4570-a626-4989adad5652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:10.782986 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a32fe1fa-52ad-4570-a626-4989adad5652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:10.783690 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a32fe1fa-52ad-4570-a626-4989adad5652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:10.784558 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a32fe1fa-52ad-4570-a626-4989adad5652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:10.785851 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a32fe1fa-52ad-4570-a626-4989adad5652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:10.786162 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-436c6a69-0f0d-40b9-a1f7-fd9f633af9ce tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:10.786610 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a32fe1fa-52ad-4570-a626-4989adad5652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:10.794651 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-436c6a69-0f0d-40b9-a1f7-fd9f633af9ce tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:10.811342 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-436c6a69-0f0d-40b9-a1f7-fd9f633af9ce tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:10.813188 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-436c6a69-0f0d-40b9-a1f7-fd9f633af9ce tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:10.815145 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-436c6a69-0f0d-40b9-a1f7-fd9f633af9ce tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:10.816237 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-436c6a69-0f0d-40b9-a1f7-fd9f633af9ce tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:10.818894 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-436c6a69-0f0d-40b9-a1f7-fd9f633af9ce tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:10.819654 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-436c6a69-0f0d-40b9-a1f7-fd9f633af9ce tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:10.933384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-436c6a69-0f0d-40b9-a1f7-fd9f633af9ce tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:10.942976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-436c6a69-0f0d-40b9-a1f7-fd9f633af9ce tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1302 microversion: 2.1 time: 0.166338 Sep 01 14:01:10.943844 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 39/67] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:10 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1302 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:11.034156 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a32fe1fa-52ad-4570-a626-4989adad5652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:11.043868 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a32fe1fa-52ad-4570-a626-4989adad5652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.275493 Sep 01 14:01:11.048787 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 29/68] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:10 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:11.314296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-772395ce-a843-4c1f-9201-6ac5f57a419f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:11.315277 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-772395ce-a843-4c1f-9201-6ac5f57a419f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:11.325236 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-772395ce-a843-4c1f-9201-6ac5f57a419f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:11.328764 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-772395ce-a843-4c1f-9201-6ac5f57a419f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:11.329228 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-772395ce-a843-4c1f-9201-6ac5f57a419f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:11.330005 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-772395ce-a843-4c1f-9201-6ac5f57a419f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:11.330475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-772395ce-a843-4c1f-9201-6ac5f57a419f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:11.334879 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-772395ce-a843-4c1f-9201-6ac5f57a419f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:11.628405 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ee2551dc-fe97-45f1-875f-bfe89fef9ae0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:11.630241 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ee2551dc-fe97-45f1-875f-bfe89fef9ae0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:11.643980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee2551dc-fe97-45f1-875f-bfe89fef9ae0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:11.646264 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee2551dc-fe97-45f1-875f-bfe89fef9ae0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:11.647095 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee2551dc-fe97-45f1-875f-bfe89fef9ae0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:11.649947 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee2551dc-fe97-45f1-875f-bfe89fef9ae0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:11.651695 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee2551dc-fe97-45f1-875f-bfe89fef9ae0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:11.654700 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee2551dc-fe97-45f1-875f-bfe89fef9ae0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:11.698696 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:11.702490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=32 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:12.072310 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ee2551dc-fe97-45f1-875f-bfe89fef9ae0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:12.118677 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ee2551dc-fe97-45f1-875f-bfe89fef9ae0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:12.120919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ee2551dc-fe97-45f1-875f-bfe89fef9ae0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:12.123790 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ee2551dc-fe97-45f1-875f-bfe89fef9ae0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1351 microversion: 2.20 time: 0.502773 Sep 01 14:01:12.124995 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 30/69] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:11 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1351 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:12.207585 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-772395ce-a843-4c1f-9201-6ac5f57a419f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:12.268655 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-772395ce-a843-4c1f-9201-6ac5f57a419f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.958424 Sep 01 14:01:12.276100 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 40/70] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:11 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:12.323088 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-87422487-31f9-485a-bf24-aa956cd038c9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:12.324057 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-87422487-31f9-485a-bf24-aa956cd038c9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:12.352821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-87422487-31f9-485a-bf24-aa956cd038c9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:12.356897 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-87422487-31f9-485a-bf24-aa956cd038c9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:12.358305 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-d9eca887-d56c-4407-8661-adab18cc201f req-d8174bad-00c5-46e9-8610-25bb161e51e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b52d39-e40f-40a7-8bde-3d47790fb1d2", "tag": "08265fbd-a5f4-4e54-8590-79c40f94a17b"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:12.361543 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-87422487-31f9-485a-bf24-aa956cd038c9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:12.364905 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-87422487-31f9-485a-bf24-aa956cd038c9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:12.366129 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-87422487-31f9-485a-bf24-aa956cd038c9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:12.369951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-87422487-31f9-485a-bf24-aa956cd038c9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:12.378617 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-d9eca887-d56c-4407-8661-adab18cc201f req-d8174bad-00c5-46e9-8610-25bb161e51e9 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:12.379368 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-d9eca887-d56c-4407-8661-adab18cc201f req-d8174bad-00c5-46e9-8610-25bb161e51e9 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:12.382085 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-d9eca887-d56c-4407-8661-adab18cc201f req-d8174bad-00c5-46e9-8610-25bb161e51e9 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:12.469907 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-d9eca887-d56c-4407-8661-adab18cc201f req-d8174bad-00c5-46e9-8610-25bb161e51e9 service nova] Creating event network-changed:08265fbd-a5f4-4e54-8590-79c40f94a17b for instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 on hv-cinder-85221 Sep 01 14:01:12.470845 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-d9eca887-d56c-4407-8661-adab18cc201f req-d8174bad-00c5-46e9-8610-25bb161e51e9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127812) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 14:01:12.473683 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-d9eca887-d56c-4407-8661-adab18cc201f req-d8174bad-00c5-46e9-8610-25bb161e51e9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127812) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 14:01:12.476475 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6e8eb1bb-2138-4055-a2a3-3bc95a6ea4e8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:12.481454 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6e8eb1bb-2138-4055-a2a3-3bc95a6ea4e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:12.482258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6e8eb1bb-2138-4055-a2a3-3bc95a6ea4e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:12.483263 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6e8eb1bb-2138-4055-a2a3-3bc95a6ea4e8 None None] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:12.486620 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6e8eb1bb-2138-4055-a2a3-3bc95a6ea4e8 None None] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:12.488983 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6e8eb1bb-2138-4055-a2a3-3bc95a6ea4e8 None None] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:12.512266 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.compute.rpcapi [None req-6e8eb1bb-2138-4055-a2a3-3bc95a6ea4e8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 01 14:01:12.513301 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6e8eb1bb-2138-4055-a2a3-3bc95a6ea4e8 None None] Releasing lock "compute-rpcapi-router" {{(pid=127812) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 14:01:12.532314 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6e8eb1bb-2138-4055-a2a3-3bc95a6ea4e8 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.405878 Sep 01 14:01:12.537467 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 31/71] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:12.538677 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8fbbc731-c788-4338-b692-c57126e65e14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:12.541609 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8fbbc731-c788-4338-b692-c57126e65e14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:12.549363 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8fbbc731-c788-4338-b692-c57126e65e14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:12.550118 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8fbbc731-c788-4338-b692-c57126e65e14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:12.551681 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8fbbc731-c788-4338-b692-c57126e65e14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:12.552985 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8fbbc731-c788-4338-b692-c57126e65e14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:12.553580 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8fbbc731-c788-4338-b692-c57126e65e14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:12.554350 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8fbbc731-c788-4338-b692-c57126e65e14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:12.566993 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-87422487-31f9-485a-bf24-aa956cd038c9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:12.578400 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=4 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:12.585053 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-87422487-31f9-485a-bf24-aa956cd038c9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1300 microversion: 2.1 time: 0.306897 Sep 01 14:01:12.585660 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 41/72] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:12 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1300 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:12.947836 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8fbbc731-c788-4338-b692-c57126e65e14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:12.958112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8fbbc731-c788-4338-b692-c57126e65e14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.423680 Sep 01 14:01:12.970308 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 32/73] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:12 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:13.149157 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8af0f869-3037-4959-b22d-26587f2193b3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:13.149793 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8af0f869-3037-4959-b22d-26587f2193b3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:13.158415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8af0f869-3037-4959-b22d-26587f2193b3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:13.159288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8af0f869-3037-4959-b22d-26587f2193b3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:13.160011 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8af0f869-3037-4959-b22d-26587f2193b3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:13.160962 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8af0f869-3037-4959-b22d-26587f2193b3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:13.161908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8af0f869-3037-4959-b22d-26587f2193b3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:13.162598 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8af0f869-3037-4959-b22d-26587f2193b3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:13.296577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c6db6e81-1616-4a0c-a603-542536fbab0c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:13.297226 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c6db6e81-1616-4a0c-a603-542536fbab0c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:13.322104 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6db6e81-1616-4a0c-a603-542536fbab0c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:13.323447 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6db6e81-1616-4a0c-a603-542536fbab0c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:13.324902 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6db6e81-1616-4a0c-a603-542536fbab0c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:13.326041 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6db6e81-1616-4a0c-a603-542536fbab0c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:13.326680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6db6e81-1616-4a0c-a603-542536fbab0c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:13.327509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6db6e81-1616-4a0c-a603-542536fbab0c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:13.715536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-8af0f869-3037-4959-b22d-26587f2193b3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:13.731927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-8af0f869-3037-4959-b22d-26587f2193b3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:13.738925 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-8af0f869-3037-4959-b22d-26587f2193b3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:13.738925 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8af0f869-3037-4959-b22d-26587f2193b3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1406 microversion: 2.20 time: 0.592031 Sep 01 14:01:13.741363 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 42/74] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:13 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1406 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:13.747016 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c6db6e81-1616-4a0c-a603-542536fbab0c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:13.767299 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c6db6e81-1616-4a0c-a603-542536fbab0c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.474935 Sep 01 14:01:13.784491 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 33/75] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:13 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:13.786764 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-278b1dc1-eac0-4e70-a510-5cd32478a06a tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:13.789201 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-278b1dc1-eac0-4e70-a510-5cd32478a06a tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:13.801458 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-278b1dc1-eac0-4e70-a510-5cd32478a06a tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:13.807331 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-278b1dc1-eac0-4e70-a510-5cd32478a06a tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:13.807331 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-278b1dc1-eac0-4e70-a510-5cd32478a06a tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:13.808415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-278b1dc1-eac0-4e70-a510-5cd32478a06a tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:13.809010 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-278b1dc1-eac0-4e70-a510-5cd32478a06a tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:13.809598 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-278b1dc1-eac0-4e70-a510-5cd32478a06a tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:13.981643 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-685652df-b401-474e-86f1-1a91d66bc986 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:13.982609 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-685652df-b401-474e-86f1-1a91d66bc986 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:13.996020 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-685652df-b401-474e-86f1-1a91d66bc986 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:13.997447 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-685652df-b401-474e-86f1-1a91d66bc986 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:13.998762 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-685652df-b401-474e-86f1-1a91d66bc986 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:14.001886 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-685652df-b401-474e-86f1-1a91d66bc986 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:14.002633 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-685652df-b401-474e-86f1-1a91d66bc986 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:14.005655 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-685652df-b401-474e-86f1-1a91d66bc986 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:14.053345 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-278b1dc1-eac0-4e70-a510-5cd32478a06a tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:14.064029 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-278b1dc1-eac0-4e70-a510-5cd32478a06a tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.308640 Sep 01 14:01:14.065087 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 43/76] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:13 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:14.184836 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-685652df-b401-474e-86f1-1a91d66bc986 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:14.211783 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-685652df-b401-474e-86f1-1a91d66bc986 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.229758 Sep 01 14:01:14.212562 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 34/77] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:13 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:14.664771 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-3751bbdf-f7be-405d-8d30-ed5ef33fd619 req-d3f72f32-580b-4ff3-bb12-41147cb0ea55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bac5a33-d73f-48a4-bead-fcf039becf3a", "tag": "aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:14.685852 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-3751bbdf-f7be-405d-8d30-ed5ef33fd619 req-d3f72f32-580b-4ff3-bb12-41147cb0ea55 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:14.685852 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-3751bbdf-f7be-405d-8d30-ed5ef33fd619 req-d3f72f32-580b-4ff3-bb12-41147cb0ea55 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:14.685852 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-3751bbdf-f7be-405d-8d30-ed5ef33fd619 req-d3f72f32-580b-4ff3-bb12-41147cb0ea55 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:14.713674 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-3751bbdf-f7be-405d-8d30-ed5ef33fd619 req-d3f72f32-580b-4ff3-bb12-41147cb0ea55 service nova] Creating event network-changed:aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025 for instance 0bac5a33-d73f-48a4-bead-fcf039becf3a on hv-cinder-85221 Sep 01 14:01:14.726913 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-3751bbdf-f7be-405d-8d30-ed5ef33fd619 req-d3f72f32-580b-4ff3-bb12-41147cb0ea55 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067391 Sep 01 14:01:14.729941 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 44/78] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:14.765639 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-10da7305-b9e9-4a29-885a-4e9a0c6321e2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:14.767138 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-10da7305-b9e9-4a29-885a-4e9a0c6321e2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:14.775009 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10da7305-b9e9-4a29-885a-4e9a0c6321e2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:14.776784 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10da7305-b9e9-4a29-885a-4e9a0c6321e2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:14.776784 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10da7305-b9e9-4a29-885a-4e9a0c6321e2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:14.778291 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10da7305-b9e9-4a29-885a-4e9a0c6321e2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:14.778855 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10da7305-b9e9-4a29-885a-4e9a0c6321e2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:14.779516 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10da7305-b9e9-4a29-885a-4e9a0c6321e2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:14.796588 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cab6b387-e655-4d31-adf6-dd88b150ec09 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:14.797490 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-cab6b387-e655-4d31-adf6-dd88b150ec09 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:14.804133 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cab6b387-e655-4d31-adf6-dd88b150ec09 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:14.804766 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cab6b387-e655-4d31-adf6-dd88b150ec09 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:14.805467 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cab6b387-e655-4d31-adf6-dd88b150ec09 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:14.806946 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cab6b387-e655-4d31-adf6-dd88b150ec09 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:14.807631 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cab6b387-e655-4d31-adf6-dd88b150ec09 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:14.808256 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cab6b387-e655-4d31-adf6-dd88b150ec09 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:15.390850 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-10da7305-b9e9-4a29-885a-4e9a0c6321e2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:15.402297 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-10da7305-b9e9-4a29-885a-4e9a0c6321e2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:15.495118 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-10da7305-b9e9-4a29-885a-4e9a0c6321e2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:15.495118 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-10da7305-b9e9-4a29-885a-4e9a0c6321e2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1406 microversion: 2.20 time: 0.652215 Sep 01 14:01:15.495118 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 35/79] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:14 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1406 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:15.495118 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5837f13f-9980-484c-b593-e822774d4bee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:15.496397 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5837f13f-9980-484c-b593-e822774d4bee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:15.496397 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5837f13f-9980-484c-b593-e822774d4bee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:15.496397 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5837f13f-9980-484c-b593-e822774d4bee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:15.496397 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5837f13f-9980-484c-b593-e822774d4bee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:15.496673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5837f13f-9980-484c-b593-e822774d4bee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:15.496673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5837f13f-9980-484c-b593-e822774d4bee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:15.496673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5837f13f-9980-484c-b593-e822774d4bee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:15.496873 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cab6b387-e655-4d31-adf6-dd88b150ec09 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:15.496873 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cab6b387-e655-4d31-adf6-dd88b150ec09 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.699983 Sep 01 14:01:15.496873 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 45/80] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:14 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:15.502699 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-83647f75-fb86-49a7-a548-79ce86a80909 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:15.505173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-83647f75-fb86-49a7-a548-79ce86a80909 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:15.516506 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-83647f75-fb86-49a7-a548-79ce86a80909 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:15.517461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-83647f75-fb86-49a7-a548-79ce86a80909 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:15.518402 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-83647f75-fb86-49a7-a548-79ce86a80909 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:15.519345 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-83647f75-fb86-49a7-a548-79ce86a80909 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:15.520040 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-83647f75-fb86-49a7-a548-79ce86a80909 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:15.520674 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-83647f75-fb86-49a7-a548-79ce86a80909 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:15.878522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5837f13f-9980-484c-b593-e822774d4bee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:15.886740 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-83647f75-fb86-49a7-a548-79ce86a80909 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:15.894968 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5837f13f-9980-484c-b593-e822774d4bee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.479871 Sep 01 14:01:15.895316 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-83647f75-fb86-49a7-a548-79ce86a80909 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.401116 Sep 01 14:01:15.905523 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 36/81] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:15 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:15.905725 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 46/82] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:15 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:16.507482 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-7cf0b135-b0eb-44e5-b816-13e1cd146fc8 req-1934dbbf-5ec5-4bf1-b0cc-a14b85305bcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa", "tag": "7a4ac6bc-64b7-41cb-85da-676a789e1725"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:16.527606 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-7cf0b135-b0eb-44e5-b816-13e1cd146fc8 req-1934dbbf-5ec5-4bf1-b0cc-a14b85305bcf service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:16.528357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-7cf0b135-b0eb-44e5-b816-13e1cd146fc8 req-1934dbbf-5ec5-4bf1-b0cc-a14b85305bcf service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:16.528985 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-7cf0b135-b0eb-44e5-b816-13e1cd146fc8 req-1934dbbf-5ec5-4bf1-b0cc-a14b85305bcf service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:16.534844 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c25cab28-9a57-42c5-8259-5fd3e36129f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:16.540367 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c25cab28-9a57-42c5-8259-5fd3e36129f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:16.558306 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-7cf0b135-b0eb-44e5-b816-13e1cd146fc8 req-1934dbbf-5ec5-4bf1-b0cc-a14b85305bcf service nova] Creating event network-changed:7a4ac6bc-64b7-41cb-85da-676a789e1725 for instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa on hv-cinder-85221 Sep 01 14:01:16.568731 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c25cab28-9a57-42c5-8259-5fd3e36129f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:16.573705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-7cf0b135-b0eb-44e5-b816-13e1cd146fc8 req-1934dbbf-5ec5-4bf1-b0cc-a14b85305bcf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070036 Sep 01 14:01:16.575252 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c25cab28-9a57-42c5-8259-5fd3e36129f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:16.576033 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c25cab28-9a57-42c5-8259-5fd3e36129f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:16.577079 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 47/83] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:01:16.578637 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c25cab28-9a57-42c5-8259-5fd3e36129f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:16.581058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c25cab28-9a57-42c5-8259-5fd3e36129f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:16.585158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c25cab28-9a57-42c5-8259-5fd3e36129f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:16.588586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-812194a3-71b5-4f29-b48b-b1b40a7c177d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:16.590920 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-812194a3-71b5-4f29-b48b-b1b40a7c177d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:16.601815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-812194a3-71b5-4f29-b48b-b1b40a7c177d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:16.604713 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-812194a3-71b5-4f29-b48b-b1b40a7c177d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:16.605764 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-812194a3-71b5-4f29-b48b-b1b40a7c177d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:16.606859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-812194a3-71b5-4f29-b48b-b1b40a7c177d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:16.607402 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-812194a3-71b5-4f29-b48b-b1b40a7c177d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:16.607909 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-812194a3-71b5-4f29-b48b-b1b40a7c177d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:16.868554 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-812194a3-71b5-4f29-b48b-b1b40a7c177d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:16.880089 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-812194a3-71b5-4f29-b48b-b1b40a7c177d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:16.881735 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-812194a3-71b5-4f29-b48b-b1b40a7c177d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:16.889728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-812194a3-71b5-4f29-b48b-b1b40a7c177d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1406 microversion: 2.20 time: 0.304720 Sep 01 14:01:16.890446 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c25cab28-9a57-42c5-8259-5fd3e36129f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:16.890844 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 48/84] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:16 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:16.891423 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c25cab28-9a57-42c5-8259-5fd3e36129f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.369517 Sep 01 14:01:16.904901 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 37/85] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:16 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:16.916857 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ab80deaf-9055-4715-8f62-403592e2dde3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:16.917472 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ab80deaf-9055-4715-8f62-403592e2dde3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:16.923560 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ab80deaf-9055-4715-8f62-403592e2dde3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:16.924046 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ab80deaf-9055-4715-8f62-403592e2dde3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:16.929869 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ab80deaf-9055-4715-8f62-403592e2dde3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:16.929869 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ab80deaf-9055-4715-8f62-403592e2dde3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:16.929869 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ab80deaf-9055-4715-8f62-403592e2dde3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:16.929869 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ab80deaf-9055-4715-8f62-403592e2dde3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:17.033041 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-6cebad01-38f1-494d-ac4c-695ebe4d4497 req-332b091d-59c2-4ec9-8b54-52e588edc42b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cd0f94-a988-4e95-8369-9fb5fa9e84c7", "name": "network-vif-plugged", "status": "completed", "tag": "f3195e75-0686-4b3d-b13d-6bc016fcbc75"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:17.049008 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-6cebad01-38f1-494d-ac4c-695ebe4d4497 req-332b091d-59c2-4ec9-8b54-52e588edc42b service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:17.049406 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-6cebad01-38f1-494d-ac4c-695ebe4d4497 req-332b091d-59c2-4ec9-8b54-52e588edc42b service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:17.049910 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-6cebad01-38f1-494d-ac4c-695ebe4d4497 req-332b091d-59c2-4ec9-8b54-52e588edc42b service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:17.063585 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-6cebad01-38f1-494d-ac4c-695ebe4d4497 req-332b091d-59c2-4ec9-8b54-52e588edc42b service nova] Creating event network-vif-plugged:f3195e75-0686-4b3d-b13d-6bc016fcbc75 for instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 on hv-cinder-85221 Sep 01 14:01:17.069984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-6cebad01-38f1-494d-ac4c-695ebe4d4497 req-332b091d-59c2-4ec9-8b54-52e588edc42b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185009 Sep 01 14:01:17.083049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 49/86] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:17.083049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-87f96c16-4b89-4f42-9e0b-70678adda508 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:17.083049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-87f96c16-4b89-4f42-9e0b-70678adda508 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:17.083770 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ab80deaf-9055-4715-8f62-403592e2dde3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:17.094577 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-87f96c16-4b89-4f42-9e0b-70678adda508 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:17.095456 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-87f96c16-4b89-4f42-9e0b-70678adda508 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:17.096313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-87f96c16-4b89-4f42-9e0b-70678adda508 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:17.097073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-87f96c16-4b89-4f42-9e0b-70678adda508 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:17.097609 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-87f96c16-4b89-4f42-9e0b-70678adda508 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:17.098154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-87f96c16-4b89-4f42-9e0b-70678adda508 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:17.109825 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ab80deaf-9055-4715-8f62-403592e2dde3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.194134 Sep 01 14:01:17.109825 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 38/87] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:16 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:17.415148 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-87f96c16-4b89-4f42-9e0b-70678adda508 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:17.427154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-87f96c16-4b89-4f42-9e0b-70678adda508 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.353427 Sep 01 14:01:17.427759 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 50/88] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:17 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:17.911490 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-018f7676-c490-4db1-b1df-b170868ee73f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:17.912246 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e2b05b67-9746-4fcf-8cd0-95d768ac1608 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:17.912246 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e2b05b67-9746-4fcf-8cd0-95d768ac1608 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:17.912942 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-018f7676-c490-4db1-b1df-b170868ee73f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:17.919461 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e2b05b67-9746-4fcf-8cd0-95d768ac1608 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:17.920284 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e2b05b67-9746-4fcf-8cd0-95d768ac1608 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:17.920885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e2b05b67-9746-4fcf-8cd0-95d768ac1608 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:17.921589 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-018f7676-c490-4db1-b1df-b170868ee73f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:17.922136 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-018f7676-c490-4db1-b1df-b170868ee73f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:17.922567 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-018f7676-c490-4db1-b1df-b170868ee73f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:17.922908 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e2b05b67-9746-4fcf-8cd0-95d768ac1608 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:17.923262 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-018f7676-c490-4db1-b1df-b170868ee73f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:17.923712 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-018f7676-c490-4db1-b1df-b170868ee73f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:17.924019 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e2b05b67-9746-4fcf-8cd0-95d768ac1608 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:17.924185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-018f7676-c490-4db1-b1df-b170868ee73f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:17.926760 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e2b05b67-9746-4fcf-8cd0-95d768ac1608 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:18.280155 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-018f7676-c490-4db1-b1df-b170868ee73f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:18.283707 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e2b05b67-9746-4fcf-8cd0-95d768ac1608 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:18.290814 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-018f7676-c490-4db1-b1df-b170868ee73f tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.383026 Sep 01 14:01:18.292029 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 51/89] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:17 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:18.298172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e2b05b67-9746-4fcf-8cd0-95d768ac1608 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:18.299658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e2b05b67-9746-4fcf-8cd0-95d768ac1608 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:18.300771 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e2b05b67-9746-4fcf-8cd0-95d768ac1608 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1406 microversion: 2.20 time: 0.393459 Sep 01 14:01:18.309592 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 39/90] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:17 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1406 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:18.319754 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-371dda1d-d154-405e-b430-0f2a1d0f2299 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:18.320594 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-371dda1d-d154-405e-b430-0f2a1d0f2299 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:18.327459 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-371dda1d-d154-405e-b430-0f2a1d0f2299 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:18.328154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-371dda1d-d154-405e-b430-0f2a1d0f2299 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:18.328822 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-371dda1d-d154-405e-b430-0f2a1d0f2299 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:18.329751 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-371dda1d-d154-405e-b430-0f2a1d0f2299 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:18.330377 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-371dda1d-d154-405e-b430-0f2a1d0f2299 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:18.330961 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-371dda1d-d154-405e-b430-0f2a1d0f2299 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:18.452234 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-29a4d200-91ea-4034-a9f1-a4293d2d06e7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:18.452797 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-29a4d200-91ea-4034-a9f1-a4293d2d06e7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:18.459964 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-29a4d200-91ea-4034-a9f1-a4293d2d06e7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:18.460789 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-29a4d200-91ea-4034-a9f1-a4293d2d06e7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:18.461534 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-29a4d200-91ea-4034-a9f1-a4293d2d06e7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:18.462439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-29a4d200-91ea-4034-a9f1-a4293d2d06e7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:18.463581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-29a4d200-91ea-4034-a9f1-a4293d2d06e7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:18.464188 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-29a4d200-91ea-4034-a9f1-a4293d2d06e7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:18.785162 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-371dda1d-d154-405e-b430-0f2a1d0f2299 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:18.793641 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-371dda1d-d154-405e-b430-0f2a1d0f2299 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.500309 Sep 01 14:01:18.794359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 52/91] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:18 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:18.811538 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-29a4d200-91ea-4034-a9f1-a4293d2d06e7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:18.819608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-29a4d200-91ea-4034-a9f1-a4293d2d06e7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.371436 Sep 01 14:01:18.820180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 40/92] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:18 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:19.313355 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1d4ebd02-2bbf-4996-9ab6-ec0da2db2852 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:19.313355 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1d4ebd02-2bbf-4996-9ab6-ec0da2db2852 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:19.325043 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1c146ae8-52df-45fe-b1b4-aa40c2cbd8f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:19.326077 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1c146ae8-52df-45fe-b1b4-aa40c2cbd8f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:19.328341 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d4ebd02-2bbf-4996-9ab6-ec0da2db2852 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:19.329068 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d4ebd02-2bbf-4996-9ab6-ec0da2db2852 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:19.329685 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d4ebd02-2bbf-4996-9ab6-ec0da2db2852 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:19.330910 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d4ebd02-2bbf-4996-9ab6-ec0da2db2852 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:19.331547 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d4ebd02-2bbf-4996-9ab6-ec0da2db2852 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:19.332408 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d4ebd02-2bbf-4996-9ab6-ec0da2db2852 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:19.334300 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c146ae8-52df-45fe-b1b4-aa40c2cbd8f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:19.335161 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c146ae8-52df-45fe-b1b4-aa40c2cbd8f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:19.335786 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c146ae8-52df-45fe-b1b4-aa40c2cbd8f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:19.337024 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c146ae8-52df-45fe-b1b4-aa40c2cbd8f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:19.342212 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c146ae8-52df-45fe-b1b4-aa40c2cbd8f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:19.342212 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c146ae8-52df-45fe-b1b4-aa40c2cbd8f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:19.342425 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:19.552600 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1d4ebd02-2bbf-4996-9ab6-ec0da2db2852 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:19.555415 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1c146ae8-52df-45fe-b1b4-aa40c2cbd8f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:19.560819 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1d4ebd02-2bbf-4996-9ab6-ec0da2db2852 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.252899 Sep 01 14:01:19.564154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 53/93] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:19 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:19.564278 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1c146ae8-52df-45fe-b1b4-aa40c2cbd8f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:19.564993 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1c146ae8-52df-45fe-b1b4-aa40c2cbd8f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:19.566319 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1c146ae8-52df-45fe-b1b4-aa40c2cbd8f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1406 microversion: 2.20 time: 0.245337 Sep 01 14:01:19.566861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 41/94] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:19 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:01:19.814976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e0a9fb80-8497-4e7a-bb13-20e8eb2263f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:19.815503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e0a9fb80-8497-4e7a-bb13-20e8eb2263f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:19.821554 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e0a9fb80-8497-4e7a-bb13-20e8eb2263f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:19.822557 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e0a9fb80-8497-4e7a-bb13-20e8eb2263f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:19.823021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e0a9fb80-8497-4e7a-bb13-20e8eb2263f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:19.823710 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e0a9fb80-8497-4e7a-bb13-20e8eb2263f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:19.824161 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e0a9fb80-8497-4e7a-bb13-20e8eb2263f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:19.824586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e0a9fb80-8497-4e7a-bb13-20e8eb2263f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:19.841310 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-09b05ea0-4cf0-434a-90a9-2ab8129ef59b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:19.842051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-09b05ea0-4cf0-434a-90a9-2ab8129ef59b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:19.847912 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-09b05ea0-4cf0-434a-90a9-2ab8129ef59b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:19.848399 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-09b05ea0-4cf0-434a-90a9-2ab8129ef59b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:19.848824 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-09b05ea0-4cf0-434a-90a9-2ab8129ef59b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:19.849529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-09b05ea0-4cf0-434a-90a9-2ab8129ef59b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:19.849985 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-09b05ea0-4cf0-434a-90a9-2ab8129ef59b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:19.850461 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-09b05ea0-4cf0-434a-90a9-2ab8129ef59b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:20.023328 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e0a9fb80-8497-4e7a-bb13-20e8eb2263f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:20.032471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e0a9fb80-8497-4e7a-bb13-20e8eb2263f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.221342 Sep 01 14:01:20.033233 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 54/95] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:19 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:20.036727 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-09b05ea0-4cf0-434a-90a9-2ab8129ef59b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:20.045062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-09b05ea0-4cf0-434a-90a9-2ab8129ef59b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.208313 Sep 01 14:01:20.056809 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 42/96] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:19 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:20.580911 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2e1cfbb1-37a0-4470-a51a-ba1402d4c2ca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:20.583579 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2e1cfbb1-37a0-4470-a51a-ba1402d4c2ca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:20.588056 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2e1cfbb1-37a0-4470-a51a-ba1402d4c2ca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:20.588533 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2e1cfbb1-37a0-4470-a51a-ba1402d4c2ca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:20.588868 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7e40c71d-3d80-405b-8064-b2ff3cdd548c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:20.589332 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2e1cfbb1-37a0-4470-a51a-ba1402d4c2ca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:20.589461 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7e40c71d-3d80-405b-8064-b2ff3cdd548c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:20.589645 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2e1cfbb1-37a0-4470-a51a-ba1402d4c2ca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:20.590137 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2e1cfbb1-37a0-4470-a51a-ba1402d4c2ca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:20.590560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2e1cfbb1-37a0-4470-a51a-ba1402d4c2ca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:20.595599 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7e40c71d-3d80-405b-8064-b2ff3cdd548c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:20.596288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7e40c71d-3d80-405b-8064-b2ff3cdd548c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:20.596716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7e40c71d-3d80-405b-8064-b2ff3cdd548c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:20.597402 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7e40c71d-3d80-405b-8064-b2ff3cdd548c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:20.597878 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7e40c71d-3d80-405b-8064-b2ff3cdd548c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:20.598293 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7e40c71d-3d80-405b-8064-b2ff3cdd548c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:20.795254 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2e1cfbb1-37a0-4470-a51a-ba1402d4c2ca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:20.800038 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7e40c71d-3d80-405b-8064-b2ff3cdd548c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:20.804888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2e1cfbb1-37a0-4470-a51a-ba1402d4c2ca tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.227747 Sep 01 14:01:20.805794 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 55/97] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:20 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:20.812354 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7e40c71d-3d80-405b-8064-b2ff3cdd548c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:20.814033 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7e40c71d-3d80-405b-8064-b2ff3cdd548c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:20.815145 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7e40c71d-3d80-405b-8064-b2ff3cdd548c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1406 microversion: 2.20 time: 0.230269 Sep 01 14:01:20.817111 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 43/98] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:20 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1406 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:21.052473 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-223ecda7-0a1b-449e-9ecc-334a49f1a32d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:21.053075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-223ecda7-0a1b-449e-9ecc-334a49f1a32d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:21.059701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-223ecda7-0a1b-449e-9ecc-334a49f1a32d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:21.060182 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-223ecda7-0a1b-449e-9ecc-334a49f1a32d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:21.060602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-223ecda7-0a1b-449e-9ecc-334a49f1a32d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:21.061287 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-223ecda7-0a1b-449e-9ecc-334a49f1a32d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:21.061734 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-223ecda7-0a1b-449e-9ecc-334a49f1a32d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:21.062277 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-223ecda7-0a1b-449e-9ecc-334a49f1a32d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:21.069214 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b342dab0-1309-4b49-b1c6-f29ca1a58aa7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:21.069842 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b342dab0-1309-4b49-b1c6-f29ca1a58aa7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:21.076817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b342dab0-1309-4b49-b1c6-f29ca1a58aa7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:21.077308 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b342dab0-1309-4b49-b1c6-f29ca1a58aa7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:21.077745 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b342dab0-1309-4b49-b1c6-f29ca1a58aa7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:21.079045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b342dab0-1309-4b49-b1c6-f29ca1a58aa7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:21.079045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b342dab0-1309-4b49-b1c6-f29ca1a58aa7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:21.079329 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b342dab0-1309-4b49-b1c6-f29ca1a58aa7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:21.273119 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-223ecda7-0a1b-449e-9ecc-334a49f1a32d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:21.284248 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b342dab0-1309-4b49-b1c6-f29ca1a58aa7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:21.287246 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b342dab0-1309-4b49-b1c6-f29ca1a58aa7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.221794 Sep 01 14:01:21.288085 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 44/99] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:21 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:21.298368 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-223ecda7-0a1b-449e-9ecc-334a49f1a32d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.248873 Sep 01 14:01:21.305149 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 56/100] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:21 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:21.594383 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-9ed0e492-c430-499b-83e9-6c2f6e3ca391 req-ab246663-140f-4f64-8c9d-ec4927fd3a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b52d39-e40f-40a7-8bde-3d47790fb1d2", "name": "network-vif-plugged", "status": "completed", "tag": "08265fbd-a5f4-4e54-8590-79c40f94a17b"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:21.606205 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-9ed0e492-c430-499b-83e9-6c2f6e3ca391 req-ab246663-140f-4f64-8c9d-ec4927fd3a69 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:21.607503 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-9ed0e492-c430-499b-83e9-6c2f6e3ca391 req-ab246663-140f-4f64-8c9d-ec4927fd3a69 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:21.607943 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-9ed0e492-c430-499b-83e9-6c2f6e3ca391 req-ab246663-140f-4f64-8c9d-ec4927fd3a69 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:21.621956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-9ed0e492-c430-499b-83e9-6c2f6e3ca391 req-ab246663-140f-4f64-8c9d-ec4927fd3a69 service nova] Creating event network-vif-plugged:08265fbd-a5f4-4e54-8590-79c40f94a17b for instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 on hv-cinder-85221 Sep 01 14:01:21.627238 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-9ed0e492-c430-499b-83e9-6c2f6e3ca391 req-ab246663-140f-4f64-8c9d-ec4927fd3a69 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036933 Sep 01 14:01:21.628016 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 45/101] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:21.836720 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-67ffa894-7c73-451a-ba70-d40699be4f8d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:21.837261 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-67ffa894-7c73-451a-ba70-d40699be4f8d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:21.839160 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1d3898f6-8502-4108-820d-e42ff3e681f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:21.839894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1d3898f6-8502-4108-820d-e42ff3e681f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:21.843986 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67ffa894-7c73-451a-ba70-d40699be4f8d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:21.844468 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67ffa894-7c73-451a-ba70-d40699be4f8d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:21.844979 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67ffa894-7c73-451a-ba70-d40699be4f8d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:21.845683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67ffa894-7c73-451a-ba70-d40699be4f8d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:21.846156 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67ffa894-7c73-451a-ba70-d40699be4f8d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:21.846573 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67ffa894-7c73-451a-ba70-d40699be4f8d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:21.846913 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1d3898f6-8502-4108-820d-e42ff3e681f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:21.847389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1d3898f6-8502-4108-820d-e42ff3e681f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:21.847911 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1d3898f6-8502-4108-820d-e42ff3e681f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:21.848848 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1d3898f6-8502-4108-820d-e42ff3e681f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:21.849308 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1d3898f6-8502-4108-820d-e42ff3e681f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:21.849736 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1d3898f6-8502-4108-820d-e42ff3e681f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:22.047019 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1d3898f6-8502-4108-820d-e42ff3e681f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:22.049713 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-67ffa894-7c73-451a-ba70-d40699be4f8d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:22.055784 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1d3898f6-8502-4108-820d-e42ff3e681f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:22.057441 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1d3898f6-8502-4108-820d-e42ff3e681f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:22.057603 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-67ffa894-7c73-451a-ba70-d40699be4f8d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.224942 Sep 01 14:01:22.058239 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 57/102] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:21 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:22.058574 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1d3898f6-8502-4108-820d-e42ff3e681f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1406 microversion: 2.20 time: 0.224156 Sep 01 14:01:22.059189 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 46/103] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:21 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:01:22.320840 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b8d87cc8-e171-4f13-9e5e-3d98953db434 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:22.321027 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f5132bbf-e2af-47e6-9390-ca66a0e7f291 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:22.321603 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f5132bbf-e2af-47e6-9390-ca66a0e7f291 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:22.321793 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b8d87cc8-e171-4f13-9e5e-3d98953db434 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:22.328605 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f5132bbf-e2af-47e6-9390-ca66a0e7f291 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:22.328786 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b8d87cc8-e171-4f13-9e5e-3d98953db434 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:22.329107 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f5132bbf-e2af-47e6-9390-ca66a0e7f291 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:22.329201 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b8d87cc8-e171-4f13-9e5e-3d98953db434 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:22.329616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f5132bbf-e2af-47e6-9390-ca66a0e7f291 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:22.329735 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b8d87cc8-e171-4f13-9e5e-3d98953db434 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:22.330361 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f5132bbf-e2af-47e6-9390-ca66a0e7f291 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:22.330463 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b8d87cc8-e171-4f13-9e5e-3d98953db434 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:22.330806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b8d87cc8-e171-4f13-9e5e-3d98953db434 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:22.330965 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f5132bbf-e2af-47e6-9390-ca66a0e7f291 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:22.331253 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b8d87cc8-e171-4f13-9e5e-3d98953db434 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:22.331346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f5132bbf-e2af-47e6-9390-ca66a0e7f291 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:22.513336 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:22.532531 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b8d87cc8-e171-4f13-9e5e-3d98953db434 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:22.534336 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f5132bbf-e2af-47e6-9390-ca66a0e7f291 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:22.543115 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f5132bbf-e2af-47e6-9390-ca66a0e7f291 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.226161 Sep 01 14:01:22.543729 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b8d87cc8-e171-4f13-9e5e-3d98953db434 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.226621 Sep 01 14:01:22.544519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 58/104] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:22 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:22.545566 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 47/105] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:22 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:23.080876 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-55bdf33e-608a-4510-9cbb-bb5096f0dbbd tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:23.081410 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2305896a-a30f-4e2c-b18d-30a8c2f9c669 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:23.081752 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-55bdf33e-608a-4510-9cbb-bb5096f0dbbd tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:23.082031 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2305896a-a30f-4e2c-b18d-30a8c2f9c669 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:23.088571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bdf33e-608a-4510-9cbb-bb5096f0dbbd tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:23.089086 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2305896a-a30f-4e2c-b18d-30a8c2f9c669 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:23.089259 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bdf33e-608a-4510-9cbb-bb5096f0dbbd tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:23.090177 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2305896a-a30f-4e2c-b18d-30a8c2f9c669 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:23.090494 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bdf33e-608a-4510-9cbb-bb5096f0dbbd tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:23.090667 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2305896a-a30f-4e2c-b18d-30a8c2f9c669 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:23.090836 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bdf33e-608a-4510-9cbb-bb5096f0dbbd tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:23.090976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bdf33e-608a-4510-9cbb-bb5096f0dbbd tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:23.091168 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2305896a-a30f-4e2c-b18d-30a8c2f9c669 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:23.091307 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bdf33e-608a-4510-9cbb-bb5096f0dbbd tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:23.091439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2305896a-a30f-4e2c-b18d-30a8c2f9c669 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:23.091766 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2305896a-a30f-4e2c-b18d-30a8c2f9c669 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:23.096234 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:23.298668 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-55bdf33e-608a-4510-9cbb-bb5096f0dbbd tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:23.312411 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-55bdf33e-608a-4510-9cbb-bb5096f0dbbd tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.235278 Sep 01 14:01:23.313427 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 59/106] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:23 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:23.314852 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2305896a-a30f-4e2c-b18d-30a8c2f9c669 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:23.333644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2305896a-a30f-4e2c-b18d-30a8c2f9c669 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:23.337085 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2305896a-a30f-4e2c-b18d-30a8c2f9c669 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:23.337085 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2305896a-a30f-4e2c-b18d-30a8c2f9c669 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1406 microversion: 2.20 time: 0.259082 Sep 01 14:01:23.338856 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 48/107] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:23 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1406 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:01:23.564728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-69308497-b801-407b-8d33-84db22a0c24f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:23.565340 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-69308497-b801-407b-8d33-84db22a0c24f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:23.565632 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c9d6d2e8-3770-40e8-83b9-edd9ce4c55f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:23.566468 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c9d6d2e8-3770-40e8-83b9-edd9ce4c55f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:23.573026 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-69308497-b801-407b-8d33-84db22a0c24f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:23.573026 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-69308497-b801-407b-8d33-84db22a0c24f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:23.583357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-69308497-b801-407b-8d33-84db22a0c24f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:23.583357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-69308497-b801-407b-8d33-84db22a0c24f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:23.583357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-69308497-b801-407b-8d33-84db22a0c24f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:23.583357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-69308497-b801-407b-8d33-84db22a0c24f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:23.583847 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9d6d2e8-3770-40e8-83b9-edd9ce4c55f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:23.583847 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9d6d2e8-3770-40e8-83b9-edd9ce4c55f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:23.583847 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9d6d2e8-3770-40e8-83b9-edd9ce4c55f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:23.583847 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9d6d2e8-3770-40e8-83b9-edd9ce4c55f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:23.584540 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9d6d2e8-3770-40e8-83b9-edd9ce4c55f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:23.584540 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9d6d2e8-3770-40e8-83b9-edd9ce4c55f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:23.781943 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c9d6d2e8-3770-40e8-83b9-edd9ce4c55f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:23.790823 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c9d6d2e8-3770-40e8-83b9-edd9ce4c55f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.228098 Sep 01 14:01:23.791673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 49/108] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:23 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:23.794735 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-69308497-b801-407b-8d33-84db22a0c24f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:23.803571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-69308497-b801-407b-8d33-84db22a0c24f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.242629 Sep 01 14:01:23.804152 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 60/109] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:23 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:24.334665 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7aea3996-7fa6-48e1-9fb0-34f9e0eb2baa tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:24.335277 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7aea3996-7fa6-48e1-9fb0-34f9e0eb2baa tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:24.342032 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7aea3996-7fa6-48e1-9fb0-34f9e0eb2baa tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:24.342519 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7aea3996-7fa6-48e1-9fb0-34f9e0eb2baa tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:24.342951 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7aea3996-7fa6-48e1-9fb0-34f9e0eb2baa tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:24.343647 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7aea3996-7fa6-48e1-9fb0-34f9e0eb2baa tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:24.344089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7aea3996-7fa6-48e1-9fb0-34f9e0eb2baa tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:24.344502 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7aea3996-7fa6-48e1-9fb0-34f9e0eb2baa tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:24.360808 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-95516fe5-cae8-49e4-aa62-6a728da3bec4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:24.362402 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-95516fe5-cae8-49e4-aa62-6a728da3bec4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:24.369334 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-95516fe5-cae8-49e4-aa62-6a728da3bec4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:24.369841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-95516fe5-cae8-49e4-aa62-6a728da3bec4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:24.370274 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-95516fe5-cae8-49e4-aa62-6a728da3bec4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:24.370974 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-95516fe5-cae8-49e4-aa62-6a728da3bec4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:24.371659 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-95516fe5-cae8-49e4-aa62-6a728da3bec4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:24.372120 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-95516fe5-cae8-49e4-aa62-6a728da3bec4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:24.561176 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7aea3996-7fa6-48e1-9fb0-34f9e0eb2baa tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:24.567864 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-95516fe5-cae8-49e4-aa62-6a728da3bec4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:24.576258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7aea3996-7fa6-48e1-9fb0-34f9e0eb2baa tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.245310 Sep 01 14:01:24.577257 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 50/110] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:24 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:24.586748 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-95516fe5-cae8-49e4-aa62-6a728da3bec4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:24.589886 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-95516fe5-cae8-49e4-aa62-6a728da3bec4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:24.591259 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-95516fe5-cae8-49e4-aa62-6a728da3bec4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1406 microversion: 2.20 time: 0.234526 Sep 01 14:01:24.591922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 61/111] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:24 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:24.812161 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8e1bf4c6-c7e1-48cd-9316-2a39fc14fa1c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:24.812767 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8e1bf4c6-c7e1-48cd-9316-2a39fc14fa1c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:24.818910 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e1bf4c6-c7e1-48cd-9316-2a39fc14fa1c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:24.819541 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e1bf4c6-c7e1-48cd-9316-2a39fc14fa1c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:24.820003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e1bf4c6-c7e1-48cd-9316-2a39fc14fa1c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:24.820696 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e1bf4c6-c7e1-48cd-9316-2a39fc14fa1c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:24.821194 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e1bf4c6-c7e1-48cd-9316-2a39fc14fa1c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:24.821700 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e1bf4c6-c7e1-48cd-9316-2a39fc14fa1c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:24.832186 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-92fbfe3e-3138-40f0-9d3a-cf664fd07b98 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:24.832581 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-92fbfe3e-3138-40f0-9d3a-cf664fd07b98 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:24.840240 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92fbfe3e-3138-40f0-9d3a-cf664fd07b98 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:24.840649 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92fbfe3e-3138-40f0-9d3a-cf664fd07b98 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:24.841170 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92fbfe3e-3138-40f0-9d3a-cf664fd07b98 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:24.842086 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92fbfe3e-3138-40f0-9d3a-cf664fd07b98 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:24.842552 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92fbfe3e-3138-40f0-9d3a-cf664fd07b98 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:24.843189 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92fbfe3e-3138-40f0-9d3a-cf664fd07b98 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:25.022209 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8e1bf4c6-c7e1-48cd-9316-2a39fc14fa1c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:25.030217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8e1bf4c6-c7e1-48cd-9316-2a39fc14fa1c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.221941 Sep 01 14:01:25.030797 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 51/112] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:24 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:25.049129 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-92fbfe3e-3138-40f0-9d3a-cf664fd07b98 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:25.057572 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-92fbfe3e-3138-40f0-9d3a-cf664fd07b98 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.229391 Sep 01 14:01:25.058173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 62/113] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:24 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:25.597914 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3cb4272b-27b5-40c6-9d7d-a3450b7667be tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:25.609455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3cb4272b-27b5-40c6-9d7d-a3450b7667be tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:25.609455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3cb4272b-27b5-40c6-9d7d-a3450b7667be tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:25.609455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3cb4272b-27b5-40c6-9d7d-a3450b7667be tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:25.609455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3cb4272b-27b5-40c6-9d7d-a3450b7667be tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:25.609833 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3cb4272b-27b5-40c6-9d7d-a3450b7667be tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:25.609833 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3cb4272b-27b5-40c6-9d7d-a3450b7667be tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:25.609833 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3cb4272b-27b5-40c6-9d7d-a3450b7667be tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:25.615920 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-98a10b04-ae0f-49fc-a57e-26dd6f00a537 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:25.617199 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-98a10b04-ae0f-49fc-a57e-26dd6f00a537 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:25.628643 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-98a10b04-ae0f-49fc-a57e-26dd6f00a537 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:25.630377 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-98a10b04-ae0f-49fc-a57e-26dd6f00a537 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:25.631249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-98a10b04-ae0f-49fc-a57e-26dd6f00a537 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:25.632365 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-98a10b04-ae0f-49fc-a57e-26dd6f00a537 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:25.637937 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-98a10b04-ae0f-49fc-a57e-26dd6f00a537 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:25.637937 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-98a10b04-ae0f-49fc-a57e-26dd6f00a537 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:25.867322 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3cb4272b-27b5-40c6-9d7d-a3450b7667be tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:25.875776 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3cb4272b-27b5-40c6-9d7d-a3450b7667be tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1315 microversion: 2.1 time: 0.281765 Sep 01 14:01:25.881827 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 52/114] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:25 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:25.894275 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-98a10b04-ae0f-49fc-a57e-26dd6f00a537 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:25.903312 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-98a10b04-ae0f-49fc-a57e-26dd6f00a537 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:25.904693 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-98a10b04-ae0f-49fc-a57e-26dd6f00a537 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:25.905830 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-98a10b04-ae0f-49fc-a57e-26dd6f00a537 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1406 microversion: 2.20 time: 0.294473 Sep 01 14:01:25.906396 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 63/115] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:25 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:26.050336 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4b808357-d184-43df-a202-e2be00c32dfe tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:26.050848 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4b808357-d184-43df-a202-e2be00c32dfe tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:26.056743 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b808357-d184-43df-a202-e2be00c32dfe tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:26.057225 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b808357-d184-43df-a202-e2be00c32dfe tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:26.057660 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b808357-d184-43df-a202-e2be00c32dfe tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:26.058394 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b808357-d184-43df-a202-e2be00c32dfe tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:26.058843 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b808357-d184-43df-a202-e2be00c32dfe tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:26.059266 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b808357-d184-43df-a202-e2be00c32dfe tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:26.079591 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f666a22e-2059-4fce-bf7e-185232fed056 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:26.080202 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f666a22e-2059-4fce-bf7e-185232fed056 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:26.102599 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f666a22e-2059-4fce-bf7e-185232fed056 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:26.103431 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f666a22e-2059-4fce-bf7e-185232fed056 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:26.106332 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f666a22e-2059-4fce-bf7e-185232fed056 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:26.107340 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f666a22e-2059-4fce-bf7e-185232fed056 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:26.109846 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f666a22e-2059-4fce-bf7e-185232fed056 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:26.110524 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f666a22e-2059-4fce-bf7e-185232fed056 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:26.364746 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4b808357-d184-43df-a202-e2be00c32dfe tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:26.374804 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f666a22e-2059-4fce-bf7e-185232fed056 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:26.377979 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4b808357-d184-43df-a202-e2be00c32dfe tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.331228 Sep 01 14:01:26.378846 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 53/116] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:26 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:26.384670 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f666a22e-2059-4fce-bf7e-185232fed056 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.309549 Sep 01 14:01:26.385398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 64/117] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:26 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:26.786125 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-3fb67b1e-de16-4c35-b9eb-3842944a2710 req-47fd0f1f-60dc-4de1-9d99-d1c82e6bfb52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bac5a33-d73f-48a4-bead-fcf039becf3a", "name": "network-vif-plugged", "status": "completed", "tag": "aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:26.798605 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-3fb67b1e-de16-4c35-b9eb-3842944a2710 req-47fd0f1f-60dc-4de1-9d99-d1c82e6bfb52 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:26.799229 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-3fb67b1e-de16-4c35-b9eb-3842944a2710 req-47fd0f1f-60dc-4de1-9d99-d1c82e6bfb52 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:26.799765 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-3fb67b1e-de16-4c35-b9eb-3842944a2710 req-47fd0f1f-60dc-4de1-9d99-d1c82e6bfb52 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:26.815178 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-3fb67b1e-de16-4c35-b9eb-3842944a2710 req-47fd0f1f-60dc-4de1-9d99-d1c82e6bfb52 service nova] Creating event network-vif-plugged:aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025 for instance 0bac5a33-d73f-48a4-bead-fcf039becf3a on hv-cinder-85221 Sep 01 14:01:26.830326 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-3fb67b1e-de16-4c35-b9eb-3842944a2710 req-47fd0f1f-60dc-4de1-9d99-d1c82e6bfb52 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050357 Sep 01 14:01:26.831022 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 54/118] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:01:26.897690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-428ea9ca-2fc9-418f-a09c-b245d0cb5e4c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:26.898819 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-428ea9ca-2fc9-418f-a09c-b245d0cb5e4c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:26.905450 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-428ea9ca-2fc9-418f-a09c-b245d0cb5e4c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:26.905971 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-428ea9ca-2fc9-418f-a09c-b245d0cb5e4c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:26.906405 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-428ea9ca-2fc9-418f-a09c-b245d0cb5e4c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:26.907107 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-428ea9ca-2fc9-418f-a09c-b245d0cb5e4c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:26.907556 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-428ea9ca-2fc9-418f-a09c-b245d0cb5e4c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:26.907979 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-428ea9ca-2fc9-418f-a09c-b245d0cb5e4c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:26.929732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5db8a059-3d14-4466-9d12-7e4572535f81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:26.930730 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5db8a059-3d14-4466-9d12-7e4572535f81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:26.943511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5db8a059-3d14-4466-9d12-7e4572535f81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:26.944091 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5db8a059-3d14-4466-9d12-7e4572535f81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:26.944570 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5db8a059-3d14-4466-9d12-7e4572535f81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:26.949308 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5db8a059-3d14-4466-9d12-7e4572535f81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:26.949804 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5db8a059-3d14-4466-9d12-7e4572535f81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:26.950239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5db8a059-3d14-4466-9d12-7e4572535f81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:27.233985 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-428ea9ca-2fc9-418f-a09c-b245d0cb5e4c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:27.249729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-428ea9ca-2fc9-418f-a09c-b245d0cb5e4c tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1502 microversion: 2.1 time: 0.355601 Sep 01 14:01:27.262663 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 65/119] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:26 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1502 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:27.265264 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5db8a059-3d14-4466-9d12-7e4572535f81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:27.281807 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5db8a059-3d14-4466-9d12-7e4572535f81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:27.283406 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5db8a059-3d14-4466-9d12-7e4572535f81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:27.284593 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5db8a059-3d14-4466-9d12-7e4572535f81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1406 microversion: 2.20 time: 0.359679 Sep 01 14:01:27.285333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 55/120] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:26 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:27.403602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2d3138a2-9a82-4527-b4fc-7477054520f9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:27.404751 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2d3138a2-9a82-4527-b4fc-7477054520f9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:27.410070 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-830f8d87-400a-4eff-9f05-d0d83983990a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:27.411940 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-830f8d87-400a-4eff-9f05-d0d83983990a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:27.418507 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d3138a2-9a82-4527-b4fc-7477054520f9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:27.420658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d3138a2-9a82-4527-b4fc-7477054520f9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:27.422207 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d3138a2-9a82-4527-b4fc-7477054520f9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:27.424110 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d3138a2-9a82-4527-b4fc-7477054520f9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:27.424982 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d3138a2-9a82-4527-b4fc-7477054520f9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:27.426890 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d3138a2-9a82-4527-b4fc-7477054520f9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:27.428842 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-830f8d87-400a-4eff-9f05-d0d83983990a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:27.429693 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-830f8d87-400a-4eff-9f05-d0d83983990a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:27.430514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-830f8d87-400a-4eff-9f05-d0d83983990a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:27.444192 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-830f8d87-400a-4eff-9f05-d0d83983990a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:27.445264 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-830f8d87-400a-4eff-9f05-d0d83983990a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:27.446068 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-830f8d87-400a-4eff-9f05-d0d83983990a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:27.648214 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2d3138a2-9a82-4527-b4fc-7477054520f9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:27.656375 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2d3138a2-9a82-4527-b4fc-7477054520f9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.258263 Sep 01 14:01:27.656950 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 66/121] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:27 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:27.696552 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-830f8d87-400a-4eff-9f05-d0d83983990a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:27.704447 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-830f8d87-400a-4eff-9f05-d0d83983990a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1363 microversion: 2.1 time: 0.301876 Sep 01 14:01:27.705038 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 56/122] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:27 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:28.359280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f61988f4-532d-4303-bb9e-b477bc575aa4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:28.361745 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f61988f4-532d-4303-bb9e-b477bc575aa4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:28.375228 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f61988f4-532d-4303-bb9e-b477bc575aa4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:28.376351 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f61988f4-532d-4303-bb9e-b477bc575aa4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:28.377153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f61988f4-532d-4303-bb9e-b477bc575aa4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:28.378422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f61988f4-532d-4303-bb9e-b477bc575aa4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:28.379455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f61988f4-532d-4303-bb9e-b477bc575aa4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:28.380602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f61988f4-532d-4303-bb9e-b477bc575aa4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:28.679315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-917bd8ae-4089-4263-a46f-25495920e60b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:28.680795 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-917bd8ae-4089-4263-a46f-25495920e60b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:28.693059 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-917bd8ae-4089-4263-a46f-25495920e60b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:28.693575 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-917bd8ae-4089-4263-a46f-25495920e60b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:28.694049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-917bd8ae-4089-4263-a46f-25495920e60b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:28.695258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-917bd8ae-4089-4263-a46f-25495920e60b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:28.695732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-917bd8ae-4089-4263-a46f-25495920e60b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:28.714773 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-917bd8ae-4089-4263-a46f-25495920e60b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:28.718582 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f61988f4-532d-4303-bb9e-b477bc575aa4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:28.729095 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f61988f4-532d-4303-bb9e-b477bc575aa4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:28.731422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f61988f4-532d-4303-bb9e-b477bc575aa4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:28.733586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f61988f4-532d-4303-bb9e-b477bc575aa4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1406 microversion: 2.20 time: 0.388691 Sep 01 14:01:28.734576 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 67/123] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:28 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:28.740217 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cf977e9f-195a-4535-bd16-dc22e1df7cac tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:28.740847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-cf977e9f-195a-4535-bd16-dc22e1df7cac tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:28.750596 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf977e9f-195a-4535-bd16-dc22e1df7cac tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:28.751392 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf977e9f-195a-4535-bd16-dc22e1df7cac tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:28.752219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf977e9f-195a-4535-bd16-dc22e1df7cac tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:28.753183 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf977e9f-195a-4535-bd16-dc22e1df7cac tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:28.753906 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf977e9f-195a-4535-bd16-dc22e1df7cac tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:28.754607 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf977e9f-195a-4535-bd16-dc22e1df7cac tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:29.001802 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-917bd8ae-4089-4263-a46f-25495920e60b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:29.012264 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cf977e9f-195a-4535-bd16-dc22e1df7cac tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:29.012516 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-917bd8ae-4089-4263-a46f-25495920e60b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.337150 Sep 01 14:01:29.013480 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 57/124] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:28 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:29.020054 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-0246624d-3860-4834-a7f5-f437fadc2bce req-5b9b0cfa-8002-472b-84db-18192c197cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa", "name": "network-vif-plugged", "status": "completed", "tag": "7a4ac6bc-64b7-41cb-85da-676a789e1725"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:29.022052 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cf977e9f-195a-4535-bd16-dc22e1df7cac tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1548 microversion: 2.1 time: 0.285664 Sep 01 14:01:29.022709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 68/125] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:28 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1548 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:29.036201 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0246624d-3860-4834-a7f5-f437fadc2bce req-5b9b0cfa-8002-472b-84db-18192c197cb9 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:29.037105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0246624d-3860-4834-a7f5-f437fadc2bce req-5b9b0cfa-8002-472b-84db-18192c197cb9 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:29.037756 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0246624d-3860-4834-a7f5-f437fadc2bce req-5b9b0cfa-8002-472b-84db-18192c197cb9 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:29.052146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-0246624d-3860-4834-a7f5-f437fadc2bce req-5b9b0cfa-8002-472b-84db-18192c197cb9 service nova] Creating event network-vif-plugged:7a4ac6bc-64b7-41cb-85da-676a789e1725 for instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa on hv-cinder-85221 Sep 01 14:01:29.057487 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8698bc2c-e96e-41a5-8dbf-2c404db1df2a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:29.057906 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-0246624d-3860-4834-a7f5-f437fadc2bce req-5b9b0cfa-8002-472b-84db-18192c197cb9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042411 Sep 01 14:01:29.058404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8698bc2c-e96e-41a5-8dbf-2c404db1df2a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:29.058575 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 58/126] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:29.067710 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8698bc2c-e96e-41a5-8dbf-2c404db1df2a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:29.068324 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8698bc2c-e96e-41a5-8dbf-2c404db1df2a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:29.068770 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8698bc2c-e96e-41a5-8dbf-2c404db1df2a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:29.069504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8698bc2c-e96e-41a5-8dbf-2c404db1df2a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:29.070016 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8698bc2c-e96e-41a5-8dbf-2c404db1df2a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:29.070439 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8698bc2c-e96e-41a5-8dbf-2c404db1df2a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:29.211048 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8698bc2c-e96e-41a5-8dbf-2c404db1df2a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160909 Sep 01 14:01:29.211666 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 69/127] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 1 14:01:29 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:01:29.758705 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ef29582c-c515-4125-b602-6604eac1d7b1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:29.759375 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ef29582c-c515-4125-b602-6604eac1d7b1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:29.767872 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef29582c-c515-4125-b602-6604eac1d7b1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:29.767872 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef29582c-c515-4125-b602-6604eac1d7b1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:29.767872 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef29582c-c515-4125-b602-6604eac1d7b1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:29.767872 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef29582c-c515-4125-b602-6604eac1d7b1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:29.768404 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef29582c-c515-4125-b602-6604eac1d7b1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:29.768779 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef29582c-c515-4125-b602-6604eac1d7b1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:29.887809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-be5180b4-cd80-4638-88d3-561acfad4fe7 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee48aba6-fa2d-4f0d-88aa-2a763d719f7c"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:29.890683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-be5180b4-cd80-4638-88d3-561acfad4fe7 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:29.898256 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-be5180b4-cd80-4638-88d3-561acfad4fe7 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:29.898900 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-be5180b4-cd80-4638-88d3-561acfad4fe7 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:29.899358 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-be5180b4-cd80-4638-88d3-561acfad4fe7 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:29.900235 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-be5180b4-cd80-4638-88d3-561acfad4fe7 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:29.900691 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-be5180b4-cd80-4638-88d3-561acfad4fe7 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:29.901114 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-be5180b4-cd80-4638-88d3-561acfad4fe7 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:29.906043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:30.156895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ef29582c-c515-4125-b602-6604eac1d7b1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:30.166187 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ef29582c-c515-4125-b602-6604eac1d7b1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:30.168719 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ef29582c-c515-4125-b602-6604eac1d7b1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:30.169928 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ef29582c-c515-4125-b602-6604eac1d7b1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1406 microversion: 2.20 time: 0.416106 Sep 01 14:01:30.170502 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 59/128] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:29 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1406 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:30.176679 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f5c881b7-cb73-4255-bb66-1e5a23810fff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:30.177288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f5c881b7-cb73-4255-bb66-1e5a23810fff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:30.195729 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f5c881b7-cb73-4255-bb66-1e5a23810fff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:30.200377 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f5c881b7-cb73-4255-bb66-1e5a23810fff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:30.201583 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f5c881b7-cb73-4255-bb66-1e5a23810fff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:30.204659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f5c881b7-cb73-4255-bb66-1e5a23810fff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:30.206480 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f5c881b7-cb73-4255-bb66-1e5a23810fff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:30.207924 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f5c881b7-cb73-4255-bb66-1e5a23810fff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:30.471726 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f5c881b7-cb73-4255-bb66-1e5a23810fff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:30.488857 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f5c881b7-cb73-4255-bb66-1e5a23810fff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.316770 Sep 01 14:01:30.502703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 60/129] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:30 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:31.203304 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c79ac628-9e11-442a-95fd-d78ecf999913 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:31.204657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c79ac628-9e11-442a-95fd-d78ecf999913 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:31.211934 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c79ac628-9e11-442a-95fd-d78ecf999913 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:31.212507 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c79ac628-9e11-442a-95fd-d78ecf999913 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:31.212949 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c79ac628-9e11-442a-95fd-d78ecf999913 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:31.214397 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c79ac628-9e11-442a-95fd-d78ecf999913 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:31.214592 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c79ac628-9e11-442a-95fd-d78ecf999913 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:31.214970 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c79ac628-9e11-442a-95fd-d78ecf999913 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:31.435574 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c79ac628-9e11-442a-95fd-d78ecf999913 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:31.449014 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c79ac628-9e11-442a-95fd-d78ecf999913 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:31.449014 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c79ac628-9e11-442a-95fd-d78ecf999913 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:31.449502 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c79ac628-9e11-442a-95fd-d78ecf999913 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1597 microversion: 2.20 time: 0.252138 Sep 01 14:01:31.450223 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 61/130] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:01:31 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1597 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:01:31.456956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-8a4db218-9d7f-4af5-8a3e-fcc9f52a7060 req-13efde3e-ad98-4fef-b078-c3ec90742cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95b52d39-e40f-40a7-8bde-3d47790fb1d2", "tag": "08265fbd-a5f4-4e54-8590-79c40f94a17b"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:31.483636 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-8a4db218-9d7f-4af5-8a3e-fcc9f52a7060 req-13efde3e-ad98-4fef-b078-c3ec90742cbd service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:31.484637 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-8a4db218-9d7f-4af5-8a3e-fcc9f52a7060 req-13efde3e-ad98-4fef-b078-c3ec90742cbd service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:31.485387 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-8a4db218-9d7f-4af5-8a3e-fcc9f52a7060 req-13efde3e-ad98-4fef-b078-c3ec90742cbd service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:31.501949 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-8a4db218-9d7f-4af5-8a3e-fcc9f52a7060 req-13efde3e-ad98-4fef-b078-c3ec90742cbd service nova] Creating event network-changed:08265fbd-a5f4-4e54-8590-79c40f94a17b for instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 on hv-cinder-85221 Sep 01 14:01:31.507847 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-8a4db218-9d7f-4af5-8a3e-fcc9f52a7060 req-13efde3e-ad98-4fef-b078-c3ec90742cbd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056004 Sep 01 14:01:31.508818 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 62/131] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:31.514872 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-df70581d-4740-4a77-a527-d95ab5f006ac tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:31.515393 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-df70581d-4740-4a77-a527-d95ab5f006ac tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:31.523823 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df70581d-4740-4a77-a527-d95ab5f006ac tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:31.524426 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df70581d-4740-4a77-a527-d95ab5f006ac tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:31.524933 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df70581d-4740-4a77-a527-d95ab5f006ac tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:31.525713 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df70581d-4740-4a77-a527-d95ab5f006ac tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:31.526730 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df70581d-4740-4a77-a527-d95ab5f006ac tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:31.526730 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df70581d-4740-4a77-a527-d95ab5f006ac tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:31.530683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-be5180b4-cd80-4638-88d3-561acfad4fe7 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "POST /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.645941 Sep 01 14:01:31.534219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 70/132] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:01:29 2022] POST /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7/os-volume_attachments => generated 194 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:01:31.540934 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-858967c5-4778-42f2-9928-4598a67524db tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:31.542732 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-858967c5-4778-42f2-9928-4598a67524db tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:31.552958 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-858967c5-4778-42f2-9928-4598a67524db tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:31.554098 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-858967c5-4778-42f2-9928-4598a67524db tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:31.554910 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-858967c5-4778-42f2-9928-4598a67524db tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:31.556047 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-858967c5-4778-42f2-9928-4598a67524db tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:31.556703 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-858967c5-4778-42f2-9928-4598a67524db tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:31.557300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-858967c5-4778-42f2-9928-4598a67524db tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:31.780594 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-df70581d-4740-4a77-a527-d95ab5f006ac tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.270434 Sep 01 14:01:31.781200 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 63/133] 10.222.0.61 () {60 vars in 1316 bytes} [Thu Sep 1 14:01:31 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-interface => generated 285 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:01:31.925655 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-858967c5-4778-42f2-9928-4598a67524db tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:31.937711 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-858967c5-4778-42f2-9928-4598a67524db tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1368 microversion: 2.1 time: 0.400577 Sep 01 14:01:31.938412 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 71/134] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:31 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1368 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:32.961943 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-eedbe79a-b7ed-42a0-88dd-2511f991eee9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:32.962857 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-eedbe79a-b7ed-42a0-88dd-2511f991eee9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:32.974641 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eedbe79a-b7ed-42a0-88dd-2511f991eee9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:32.975280 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eedbe79a-b7ed-42a0-88dd-2511f991eee9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:32.977010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eedbe79a-b7ed-42a0-88dd-2511f991eee9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:32.978334 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eedbe79a-b7ed-42a0-88dd-2511f991eee9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:32.980411 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eedbe79a-b7ed-42a0-88dd-2511f991eee9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:32.980854 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eedbe79a-b7ed-42a0-88dd-2511f991eee9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.222573 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-eedbe79a-b7ed-42a0-88dd-2511f991eee9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:33.240956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-eedbe79a-b7ed-42a0-88dd-2511f991eee9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1559 microversion: 2.1 time: 0.284277 Sep 01 14:01:33.242355 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 64/135] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:32 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1559 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:33.262966 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f1ae715d-33fa-4f3a-bc3d-10b5917b6ee7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:33.264289 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f1ae715d-33fa-4f3a-bc3d-10b5917b6ee7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:33.271661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f1ae715d-33fa-4f3a-bc3d-10b5917b6ee7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.272442 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f1ae715d-33fa-4f3a-bc3d-10b5917b6ee7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.273064 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f1ae715d-33fa-4f3a-bc3d-10b5917b6ee7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.274235 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f1ae715d-33fa-4f3a-bc3d-10b5917b6ee7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.275104 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f1ae715d-33fa-4f3a-bc3d-10b5917b6ee7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.275930 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f1ae715d-33fa-4f3a-bc3d-10b5917b6ee7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.439946 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f1ae715d-33fa-4f3a-bc3d-10b5917b6ee7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.180901 Sep 01 14:01:33.440556 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 72/136] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 1 14:01:33 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:33.757133 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-6c887954-304d-472f-8ada-86410c3f6c43 req-662d3948-d8c1-4c2f-a065-93b83e00699b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bac5a33-d73f-48a4-bead-fcf039becf3a", "tag": "aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:33.774314 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-6c887954-304d-472f-8ada-86410c3f6c43 req-662d3948-d8c1-4c2f-a065-93b83e00699b service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:33.775159 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-6c887954-304d-472f-8ada-86410c3f6c43 req-662d3948-d8c1-4c2f-a065-93b83e00699b service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:33.775876 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-6c887954-304d-472f-8ada-86410c3f6c43 req-662d3948-d8c1-4c2f-a065-93b83e00699b service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:33.827053 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-6c887954-304d-472f-8ada-86410c3f6c43 req-662d3948-d8c1-4c2f-a065-93b83e00699b service nova] Creating event network-changed:aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025 for instance 0bac5a33-d73f-48a4-bead-fcf039becf3a on hv-cinder-85221 Sep 01 14:01:33.842914 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-6c887954-304d-472f-8ada-86410c3f6c43 req-662d3948-d8c1-4c2f-a065-93b83e00699b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093058 Sep 01 14:01:33.844336 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 65/137] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:01:35.673428 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-fce26289-bbf2-4e70-9680-fff1540b09df req-b39138d1-2cb0-4827-9d89-d706027f5d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa", "tag": "7a4ac6bc-64b7-41cb-85da-676a789e1725"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:35.709570 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-fce26289-bbf2-4e70-9680-fff1540b09df req-b39138d1-2cb0-4827-9d89-d706027f5d0b service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:35.710195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-fce26289-bbf2-4e70-9680-fff1540b09df req-b39138d1-2cb0-4827-9d89-d706027f5d0b service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:35.710639 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-fce26289-bbf2-4e70-9680-fff1540b09df req-b39138d1-2cb0-4827-9d89-d706027f5d0b service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:35.741140 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-fce26289-bbf2-4e70-9680-fff1540b09df req-b39138d1-2cb0-4827-9d89-d706027f5d0b service nova] Creating event network-changed:7a4ac6bc-64b7-41cb-85da-676a789e1725 for instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa on hv-cinder-85221 Sep 01 14:01:35.752659 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-fce26289-bbf2-4e70-9680-fff1540b09df req-b39138d1-2cb0-4827-9d89-d706027f5d0b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083795 Sep 01 14:01:35.753617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 73/138] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:01:44.653143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=82 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:44.653948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=88 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:44.658433 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-66d49d44-760a-4f09-b7de-d202ecd9c6ab tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:44.658930 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-66d49d44-760a-4f09-b7de-d202ecd9c6ab tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:44.666519 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-66d49d44-760a-4f09-b7de-d202ecd9c6ab tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:44.667307 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-66d49d44-760a-4f09-b7de-d202ecd9c6ab tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:44.667752 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-66d49d44-760a-4f09-b7de-d202ecd9c6ab tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:44.668565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-66d49d44-760a-4f09-b7de-d202ecd9c6ab tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:44.668960 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-66d49d44-760a-4f09-b7de-d202ecd9c6ab tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:44.669387 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-66d49d44-760a-4f09-b7de-d202ecd9c6ab tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:44.706300 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-66d49d44-760a-4f09-b7de-d202ecd9c6ab tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Going to try to terminate instance {{(pid=127812) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:01:45.123078 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-66d49d44-760a-4f09-b7de-d202ecd9c6ab tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 204 len: 0 microversion: 2.1 time: 0.470860 Sep 01 14:01:45.123696 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 66/139] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:01:44 2022] DELETE /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:01:45.132759 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3de3ce52-ca8b-4951-b846-d3a8c1f95295 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:45.133449 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3de3ce52-ca8b-4951-b846-d3a8c1f95295 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:45.136732 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=71 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:01:45.142012 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3de3ce52-ca8b-4951-b846-d3a8c1f95295 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:45.142500 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3de3ce52-ca8b-4951-b846-d3a8c1f95295 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:45.142930 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3de3ce52-ca8b-4951-b846-d3a8c1f95295 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:45.143628 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3de3ce52-ca8b-4951-b846-d3a8c1f95295 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:45.144075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3de3ce52-ca8b-4951-b846-d3a8c1f95295 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:45.144493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3de3ce52-ca8b-4951-b846-d3a8c1f95295 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:45.298229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3de3ce52-ca8b-4951-b846-d3a8c1f95295 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:45.306581 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3de3ce52-ca8b-4951-b846-d3a8c1f95295 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1554 microversion: 2.1 time: 0.178153 Sep 01 14:01:45.307911 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 74/140] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:45 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:46.329270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b904e9f0-f3a8-4f61-ab5a-9bd5fcd09570 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:46.329997 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b904e9f0-f3a8-4f61-ab5a-9bd5fcd09570 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:46.336428 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b904e9f0-f3a8-4f61-ab5a-9bd5fcd09570 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:46.336920 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b904e9f0-f3a8-4f61-ab5a-9bd5fcd09570 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:46.337356 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b904e9f0-f3a8-4f61-ab5a-9bd5fcd09570 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:46.338603 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b904e9f0-f3a8-4f61-ab5a-9bd5fcd09570 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:46.339060 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b904e9f0-f3a8-4f61-ab5a-9bd5fcd09570 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:46.339485 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b904e9f0-f3a8-4f61-ab5a-9bd5fcd09570 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:46.485924 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b904e9f0-f3a8-4f61-ab5a-9bd5fcd09570 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:46.494857 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b904e9f0-f3a8-4f61-ab5a-9bd5fcd09570 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1554 microversion: 2.1 time: 0.169808 Sep 01 14:01:46.501480 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 67/141] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:46 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:47.517913 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-08f859b9-52a6-4b0f-af9a-ae3b496dbfdb tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:47.519874 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-08f859b9-52a6-4b0f-af9a-ae3b496dbfdb tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:47.525679 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08f859b9-52a6-4b0f-af9a-ae3b496dbfdb tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:47.526221 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08f859b9-52a6-4b0f-af9a-ae3b496dbfdb tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:47.526747 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08f859b9-52a6-4b0f-af9a-ae3b496dbfdb tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:47.527463 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08f859b9-52a6-4b0f-af9a-ae3b496dbfdb tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:47.527916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08f859b9-52a6-4b0f-af9a-ae3b496dbfdb tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:47.528338 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08f859b9-52a6-4b0f-af9a-ae3b496dbfdb tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:47.672167 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-08f859b9-52a6-4b0f-af9a-ae3b496dbfdb tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:47.680750 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-08f859b9-52a6-4b0f-af9a-ae3b496dbfdb tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1554 microversion: 2.1 time: 0.167059 Sep 01 14:01:47.681339 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 75/142] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:47 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:48.707440 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7fe032e6-65b7-4609-ad59-81d5a2466fa3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:48.708556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7fe032e6-65b7-4609-ad59-81d5a2466fa3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:48.719419 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7fe032e6-65b7-4609-ad59-81d5a2466fa3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:48.719419 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7fe032e6-65b7-4609-ad59-81d5a2466fa3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:48.720629 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7fe032e6-65b7-4609-ad59-81d5a2466fa3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:48.720971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7fe032e6-65b7-4609-ad59-81d5a2466fa3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:48.721644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7fe032e6-65b7-4609-ad59-81d5a2466fa3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:48.722935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7fe032e6-65b7-4609-ad59-81d5a2466fa3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:48.883715 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7fe032e6-65b7-4609-ad59-81d5a2466fa3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:48.892492 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7fe032e6-65b7-4609-ad59-81d5a2466fa3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1554 microversion: 2.1 time: 0.192283 Sep 01 14:01:48.893121 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 68/143] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:48 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:01:49.920124 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d7ce343e-3a5b-4369-9839-64b7d3c4257e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:49.921018 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d7ce343e-3a5b-4369-9839-64b7d3c4257e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:49.927780 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7ce343e-3a5b-4369-9839-64b7d3c4257e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:49.932661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7ce343e-3a5b-4369-9839-64b7d3c4257e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:49.932661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7ce343e-3a5b-4369-9839-64b7d3c4257e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:49.932661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7ce343e-3a5b-4369-9839-64b7d3c4257e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:49.932661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7ce343e-3a5b-4369-9839-64b7d3c4257e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:49.933254 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7ce343e-3a5b-4369-9839-64b7d3c4257e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:50.171741 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d7ce343e-3a5b-4369-9839-64b7d3c4257e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:50.192885 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d7ce343e-3a5b-4369-9839-64b7d3c4257e tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1554 microversion: 2.1 time: 0.277606 Sep 01 14:01:50.192885 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 76/144] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:49 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1554 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:51.236770 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-fc48e901-4853-4289-b440-546a35f0a7e1 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:51.239447 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fc48e901-4853-4289-b440-546a35f0a7e1 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:51.254499 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fc48e901-4853-4289-b440-546a35f0a7e1 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:51.255321 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fc48e901-4853-4289-b440-546a35f0a7e1 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:51.256077 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fc48e901-4853-4289-b440-546a35f0a7e1 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:51.257255 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fc48e901-4853-4289-b440-546a35f0a7e1 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:51.258065 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fc48e901-4853-4289-b440-546a35f0a7e1 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:51.258848 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fc48e901-4853-4289-b440-546a35f0a7e1 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:51.423620 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fc48e901-4853-4289-b440-546a35f0a7e1 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:51.432962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-fc48e901-4853-4289-b440-546a35f0a7e1 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1554 microversion: 2.1 time: 0.206792 Sep 01 14:01:51.438029 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 69/145] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:51 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1554 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:52.461217 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-59e38974-5c5c-4d87-b528-97f90260da3d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:52.469619 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-59e38974-5c5c-4d87-b528-97f90260da3d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:52.519812 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-59e38974-5c5c-4d87-b528-97f90260da3d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:52.520634 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-59e38974-5c5c-4d87-b528-97f90260da3d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:52.522442 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-59e38974-5c5c-4d87-b528-97f90260da3d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:52.525986 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-59e38974-5c5c-4d87-b528-97f90260da3d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:52.527874 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-59e38974-5c5c-4d87-b528-97f90260da3d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:52.528895 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-59e38974-5c5c-4d87-b528-97f90260da3d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:52.907862 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-59e38974-5c5c-4d87-b528-97f90260da3d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:52.929801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-59e38974-5c5c-4d87-b528-97f90260da3d tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1554 microversion: 2.1 time: 0.477699 Sep 01 14:01:52.930878 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 77/146] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:52 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1554 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:53.510860 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-47693b85-e250-4aba-b7e5-faf59ce6466a req-423cb7b0-d419-4be2-892a-be5be558b2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cd0f94-a988-4e95-8369-9fb5fa9e84c7", "name": "network-vif-deleted", "tag": "f3195e75-0686-4b3d-b13d-6bc016fcbc75"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:01:53.531334 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-47693b85-e250-4aba-b7e5-faf59ce6466a req-423cb7b0-d419-4be2-892a-be5be558b2ed service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:53.532153 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-47693b85-e250-4aba-b7e5-faf59ce6466a req-423cb7b0-d419-4be2-892a-be5be558b2ed service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:53.532903 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-47693b85-e250-4aba-b7e5-faf59ce6466a req-423cb7b0-d419-4be2-892a-be5be558b2ed service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:53.559410 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-47693b85-e250-4aba-b7e5-faf59ce6466a req-423cb7b0-d419-4be2-892a-be5be558b2ed service nova] Creating event network-vif-deleted:f3195e75-0686-4b3d-b13d-6bc016fcbc75 for instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 on hv-cinder-85221 Sep 01 14:01:53.571152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-47693b85-e250-4aba-b7e5-faf59ce6466a req-423cb7b0-d419-4be2-892a-be5be558b2ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068516 Sep 01 14:01:53.578031 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 70/147] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:01:53.962295 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-fbc27da6-1d1b-49e8-9d99-23f085481618 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:53.963529 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-fbc27da6-1d1b-49e8-9d99-23f085481618 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:53.974449 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fbc27da6-1d1b-49e8-9d99-23f085481618 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:53.974950 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fbc27da6-1d1b-49e8-9d99-23f085481618 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:53.975386 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fbc27da6-1d1b-49e8-9d99-23f085481618 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:53.976090 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fbc27da6-1d1b-49e8-9d99-23f085481618 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:53.976742 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fbc27da6-1d1b-49e8-9d99-23f085481618 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:53.977317 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fbc27da6-1d1b-49e8-9d99-23f085481618 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:54.044692 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fbc27da6-1d1b-49e8-9d99-23f085481618 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:54.053496 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-fbc27da6-1d1b-49e8-9d99-23f085481618 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1346 microversion: 2.1 time: 0.098607 Sep 01 14:01:54.054126 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 78/148] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:53 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:55.082190 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:55.084149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:55.097265 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:55.098505 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:55.099972 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:55.101504 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:55.102893 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:55.104991 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:55.185190 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:55.186398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:55.187304 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:55.188145 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lazy-loading 'fault' on Instance uuid c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:01:55.354263 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a70246b8e8b842129c99827859b90478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c53449be8e448b09a184ea79278bb2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:01:55.372682 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c7ec9e04-77e4-4afe-9b53-4dc982576698 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 200 len: 1351 microversion: 2.1 time: 0.299047 Sep 01 14:01:55.387090 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 71/149] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:55 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 1351 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:01:56.411953 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d590792d-a450-4707-beff-6c00167407f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:56.413542 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d590792d-a450-4707-beff-6c00167407f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:56.426395 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d590792d-a450-4707-beff-6c00167407f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:56.427746 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d590792d-a450-4707-beff-6c00167407f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:56.428489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d590792d-a450-4707-beff-6c00167407f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:56.429892 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d590792d-a450-4707-beff-6c00167407f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:56.430898 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d590792d-a450-4707-beff-6c00167407f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:56.432565 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d590792d-a450-4707-beff-6c00167407f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:56.468326 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-d590792d-a450-4707-beff-6c00167407f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] HTTP exception thrown: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d590792d-a450-4707-beff-6c00167407f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Request method failure captured: Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 HTTP/1.1 Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsMdN9XNH3vlZK_6r813J7MLGY09g03VeQjaCPf2Ci49sE3Gv4fbC7zkAKZuA37l8Cd4xeWqGiNQXtBMt7xR0_k5tE8kACltOaKyRKAXmhayWv39V9TE7dna9HO-BR7_v7zUJxldJ0WkojuM7h0YV00OehNGPUQXFVN7RD6eZqt5CQ Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 1c53449be8e448b09a184ea79278bb2a Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-DeleteServersTestJSON-1206008816 Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:01:56.476501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:01:56.482951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c53449be8e448b09a184ea79278bb2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1c53449be8e448b09a184ea79278bb2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c53449be8e448b09a184ea79278bb2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1c53449be8e448b09a184ea79278bb2a"}]}] Sep 01 14:01:56.482951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-DeleteServersTestJSON-1206008816 Sep 01 14:01:56.482951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 1c53449be8e448b09a184ea79278bb2a Sep 01 14:01:56.482951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-DeleteServersTestJSON-1206008816 Sep 01 14:01:56.482951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-DeleteServersTestJSON-1206008816-project Sep 01 14:01:56.482951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:01:56.482951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:01:56.482951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: a70246b8e8b842129c99827859b90478 Sep 01 14:01:56.482951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-DeleteServersTestJSON-1206008816-project Sep 01 14:01:56.482951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:01:56.482951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:01:56.482951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': 'c2cd0f94-a988-4e95-8369-9fb5fa9e84c7'} Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:01:56.483807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:01:56.485212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:01:56.486473 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d590792d-a450-4707-beff-6c00167407f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Returning 404 to user: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:01:56.486473 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d590792d-a450-4707-beff-6c00167407f0 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 404 len: 111 microversion: 2.1 time: 0.073227 Sep 01 14:01:56.486473 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 79/150] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:01:56 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:01:56.856922 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0f31d045-30cc-4ee3-99fd-90600f65f79b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:01:56.859315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0f31d045-30cc-4ee3-99fd-90600f65f79b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:01:56.865647 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0f31d045-30cc-4ee3-99fd-90600f65f79b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:56.869549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0f31d045-30cc-4ee3-99fd-90600f65f79b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:56.869549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0f31d045-30cc-4ee3-99fd-90600f65f79b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:56.869549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0f31d045-30cc-4ee3-99fd-90600f65f79b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:01:56.869549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0f31d045-30cc-4ee3-99fd-90600f65f79b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:01:56.870025 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0f31d045-30cc-4ee3-99fd-90600f65f79b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:01:56.885154 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-0f31d045-30cc-4ee3-99fd-90600f65f79b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] HTTP exception thrown: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0f31d045-30cc-4ee3-99fd-90600f65f79b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Request method failure captured: Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7/os-volume_attachments HTTP/1.1 Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsMdN9XNH3vlZK_6r813J7MLGY09g03VeQjaCPf2Ci49sE3Gv4fbC7zkAKZuA37l8Cd4xeWqGiNQXtBMt7xR0_k5tE8kACltOaKyRKAXmhayWv39V9TE7dna9HO-BR7_v7zUJxldJ0WkojuM7h0YV00OehNGPUQXFVN7RD6eZqt5CQ Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 1c53449be8e448b09a184ea79278bb2a Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-DeleteServersTestJSON-1206008816 Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:01:56.890143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:01:56.891557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c53449be8e448b09a184ea79278bb2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1c53449be8e448b09a184ea79278bb2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c53449be8e448b09a184ea79278bb2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1c53449be8e448b09a184ea79278bb2a"}]}] Sep 01 14:01:56.891557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-DeleteServersTestJSON-1206008816 Sep 01 14:01:56.891557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 1c53449be8e448b09a184ea79278bb2a Sep 01 14:01:56.891557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-DeleteServersTestJSON-1206008816 Sep 01 14:01:56.891557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-DeleteServersTestJSON-1206008816-project Sep 01 14:01:56.891557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:01:56.891557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:01:56.891557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: a70246b8e8b842129c99827859b90478 Sep 01 14:01:56.891557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-DeleteServersTestJSON-1206008816-project Sep 01 14:01:56.891557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:01:56.891557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:01:56.891557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'server_id': 'c2cd0f94-a988-4e95-8369-9fb5fa9e84c7'} Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:01:56.892330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:01:56.893590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:01:56.900236 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0f31d045-30cc-4ee3-99fd-90600f65f79b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Returning 404 to user: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:01:56.900236 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0f31d045-30cc-4ee3-99fd-90600f65f79b tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039374 Sep 01 14:01:56.900236 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 72/151] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:01:56 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:02:00.586267 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1d6fe086-b297-4d84-a8ae-e4d26f1ec253 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:00.586961 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1d6fe086-b297-4d84-a8ae-e4d26f1ec253 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:00.594192 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d6fe086-b297-4d84-a8ae-e4d26f1ec253 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:00.595328 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d6fe086-b297-4d84-a8ae-e4d26f1ec253 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:00.596277 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d6fe086-b297-4d84-a8ae-e4d26f1ec253 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:00.597731 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d6fe086-b297-4d84-a8ae-e4d26f1ec253 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:00.598488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d6fe086-b297-4d84-a8ae-e4d26f1ec253 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:00.599105 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d6fe086-b297-4d84-a8ae-e4d26f1ec253 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:00.606027 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-1d6fe086-b297-4d84-a8ae-e4d26f1ec253 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] HTTP exception thrown: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1d6fe086-b297-4d84-a8ae-e4d26f1ec253 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Request method failure captured: Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: DELETE /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 HTTP/1.1 Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsMdN9XNH3vlZK_6r813J7MLGY09g03VeQjaCPf2Ci49sE3Gv4fbC7zkAKZuA37l8Cd4xeWqGiNQXtBMt7xR0_k5tE8kACltOaKyRKAXmhayWv39V9TE7dna9HO-BR7_v7zUJxldJ0WkojuM7h0YV00OehNGPUQXFVN7RD6eZqt5CQ Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 1c53449be8e448b09a184ea79278bb2a Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-DeleteServersTestJSON-1206008816 Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:02:00.622073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:02:00.624260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c53449be8e448b09a184ea79278bb2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1c53449be8e448b09a184ea79278bb2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c53449be8e448b09a184ea79278bb2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1c53449be8e448b09a184ea79278bb2a"}]}] Sep 01 14:02:00.624260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-DeleteServersTestJSON-1206008816 Sep 01 14:02:00.624260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 1c53449be8e448b09a184ea79278bb2a Sep 01 14:02:00.624260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-DeleteServersTestJSON-1206008816 Sep 01 14:02:00.624260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-DeleteServersTestJSON-1206008816-project Sep 01 14:02:00.624260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:02:00.624260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:02:00.624260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: a70246b8e8b842129c99827859b90478 Sep 01 14:02:00.624260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-DeleteServersTestJSON-1206008816-project Sep 01 14:02:00.624260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:02:00.624260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:02:00.624260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': 'c2cd0f94-a988-4e95-8369-9fb5fa9e84c7'} Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:02:00.625455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:02:00.630549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:02:00.634104 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1d6fe086-b297-4d84-a8ae-e4d26f1ec253 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Returning 404 to user: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:02:00.634104 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1d6fe086-b297-4d84-a8ae-e4d26f1ec253 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 404 len: 111 microversion: 2.1 time: 0.038561 Sep 01 14:02:00.634104 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 80/152] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:02:00 2022] DELETE /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:02:00.634743 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-dc9dca13-cdf0-45cc-b0c8-e616a1f364a3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:00.634743 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-dc9dca13-cdf0-45cc-b0c8-e616a1f364a3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] [instance: c2cd0f94-a988-4e95-8369-9fb5fa9e84c7] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:00.642368 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc9dca13-cdf0-45cc-b0c8-e616a1f364a3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:00.648203 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc9dca13-cdf0-45cc-b0c8-e616a1f364a3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:00.648203 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc9dca13-cdf0-45cc-b0c8-e616a1f364a3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:00.648203 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc9dca13-cdf0-45cc-b0c8-e616a1f364a3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:00.648203 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc9dca13-cdf0-45cc-b0c8-e616a1f364a3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:00.648968 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc9dca13-cdf0-45cc-b0c8-e616a1f364a3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:00.662224 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-dc9dca13-cdf0-45cc-b0c8-e616a1f364a3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] HTTP exception thrown: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-dc9dca13-cdf0-45cc-b0c8-e616a1f364a3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Request method failure captured: Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 HTTP/1.1 Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsMdN9XNH3vlZK_6r813J7MLGY09g03VeQjaCPf2Ci49sE3Gv4fbC7zkAKZuA37l8Cd4xeWqGiNQXtBMt7xR0_k5tE8kACltOaKyRKAXmhayWv39V9TE7dna9HO-BR7_v7zUJxldJ0WkojuM7h0YV00OehNGPUQXFVN7RD6eZqt5CQ Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 1c53449be8e448b09a184ea79278bb2a Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-DeleteServersTestJSON-1206008816 Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:02:00.664651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:02:00.666612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c53449be8e448b09a184ea79278bb2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1c53449be8e448b09a184ea79278bb2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1c53449be8e448b09a184ea79278bb2a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1c53449be8e448b09a184ea79278bb2a"}]}] Sep 01 14:02:00.666612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-DeleteServersTestJSON-1206008816 Sep 01 14:02:00.666612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 1c53449be8e448b09a184ea79278bb2a Sep 01 14:02:00.666612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-DeleteServersTestJSON-1206008816 Sep 01 14:02:00.666612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-DeleteServersTestJSON-1206008816-project Sep 01 14:02:00.666612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:02:00.666612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:02:00.666612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: a70246b8e8b842129c99827859b90478 Sep 01 14:02:00.666612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-DeleteServersTestJSON-1206008816-project Sep 01 14:02:00.666612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:02:00.666612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:02:00.666612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': 'c2cd0f94-a988-4e95-8369-9fb5fa9e84c7'} Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:02:00.667333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. Sep 01 14:02:00.668581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:02:00.670145 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-dc9dca13-cdf0-45cc-b0c8-e616a1f364a3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] Returning 404 to user: Instance c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:02:00.670145 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-dc9dca13-cdf0-45cc-b0c8-e616a1f364a3 tempest-DeleteServersTestJSON-1206008816 tempest-DeleteServersTestJSON-1206008816-project] 10.222.0.61 "GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7" status: 404 len: 111 microversion: 2.1 time: 0.041651 Sep 01 14:02:00.673710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 73/153] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:00 2022] GET /compute/v2.1/servers/c2cd0f94-a988-4e95-8369-9fb5fa9e84c7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:02:17.105015 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=13 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:17.260550 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-353038318", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:17.376226 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.network.neutron [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] validate_networks() for [('241bed09-c819-467f-87d6-202417ebcf87', None, None, None, None, None)] {{(pid=127811) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:02:17.887273 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Flavor limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:02:17.887872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Image limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:02:17.888437 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Flavor pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:02:17.888928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Image pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:02:17.889494 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:02:17.899805 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:17.900309 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:17.907048 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:17.907048 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:17.907048 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:17.907048 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:17.919738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Getting quotas for project dce10589b8b240e6829f2e158415a1b8. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:02:17.925439 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Getting quotas for user 65c88d8b86544ab5825adbadb26b1e2e and project dce10589b8b240e6829f2e158415a1b8. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:02:17.938032 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Going to run 1 instances... {{(pid=127811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:02:17.944119 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:02:18.115144 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ced1502d-690f-42aa-bfbc-199c92cf09a3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.011485 Sep 01 14:02:18.118818 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 81/154] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:02:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:02:18.128107 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-55d7dd4b-df2e-49e6-92c9-28aa5034cd84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:18.131541 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-55d7dd4b-df2e-49e6-92c9-28aa5034cd84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:18.142363 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:18.145191 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:18.271237 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-55d7dd4b-df2e-49e6-92c9-28aa5034cd84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:18.280574 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-55d7dd4b-df2e-49e6-92c9-28aa5034cd84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1221 microversion: 2.1 time: 0.160285 Sep 01 14:02:18.281755 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 74/155] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:18 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1221 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:18.410296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-812626855", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:18.516366 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.network.neutron [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] validate_networks() for [('241bed09-c819-467f-87d6-202417ebcf87', None, None, None, None, None)] {{(pid=127811) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:02:19.036931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Flavor limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:02:19.037230 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Image limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:02:19.037969 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Flavor pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:02:19.038532 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Image pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:02:19.039071 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:02:19.050821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:19.051314 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:19.051829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:19.052609 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:19.053067 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:19.053599 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:19.074794 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Getting quotas for project dce10589b8b240e6829f2e158415a1b8. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:02:19.079483 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Getting quotas for user 65c88d8b86544ab5825adbadb26b1e2e and project dce10589b8b240e6829f2e158415a1b8. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:02:19.095381 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Going to run 1 instances... {{(pid=127811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:02:19.097949 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:02:19.327015 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-690f9aad-58d9-4517-ab0a-b76c3eb83e88 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.925743 Sep 01 14:02:19.334488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 82/156] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:02:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:02:19.339343 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-054c3732-e491-4343-847e-abe3540d786e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:19.340488 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-054c3732-e491-4343-847e-abe3540d786e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:19.425706 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-054c3732-e491-4343-847e-abe3540d786e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:19.439181 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-054c3732-e491-4343-847e-abe3540d786e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1221 microversion: 2.1 time: 0.103561 Sep 01 14:02:19.440388 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 75/157] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:19 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:20.481319 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-fb760d83-f49f-4a7f-a756-ff3b81b8b660 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:20.481319 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-fb760d83-f49f-4a7f-a756-ff3b81b8b660 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:20.609407 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fb760d83-f49f-4a7f-a756-ff3b81b8b660 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:20.626806 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-fb760d83-f49f-4a7f-a756-ff3b81b8b660 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1221 microversion: 2.1 time: 0.162700 Sep 01 14:02:20.642356 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 83/158] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:20 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1221 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:21.661480 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e88a0666-c9b4-48ea-8f83-3069f119e9b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:21.666628 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e88a0666-c9b4-48ea-8f83-3069f119e9b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:21.676655 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e88a0666-c9b4-48ea-8f83-3069f119e9b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:21.677314 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e88a0666-c9b4-48ea-8f83-3069f119e9b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:21.678014 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e88a0666-c9b4-48ea-8f83-3069f119e9b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:21.679215 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e88a0666-c9b4-48ea-8f83-3069f119e9b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:21.679873 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e88a0666-c9b4-48ea-8f83-3069f119e9b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:21.681079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e88a0666-c9b4-48ea-8f83-3069f119e9b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:21.762442 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e88a0666-c9b4-48ea-8f83-3069f119e9b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:21.772454 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e88a0666-c9b4-48ea-8f83-3069f119e9b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1273 microversion: 2.1 time: 0.116502 Sep 01 14:02:21.773281 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 76/159] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:21 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:22.795021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7ecd52d0-33b3-4ed1-bd80-7eaceb451bdd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:22.795627 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7ecd52d0-33b3-4ed1-bd80-7eaceb451bdd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:22.806176 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7ecd52d0-33b3-4ed1-bd80-7eaceb451bdd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:22.806587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7ecd52d0-33b3-4ed1-bd80-7eaceb451bdd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:22.812045 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7ecd52d0-33b3-4ed1-bd80-7eaceb451bdd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:22.812811 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7ecd52d0-33b3-4ed1-bd80-7eaceb451bdd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:22.813280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7ecd52d0-33b3-4ed1-bd80-7eaceb451bdd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:22.813702 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7ecd52d0-33b3-4ed1-bd80-7eaceb451bdd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:22.923303 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7ecd52d0-33b3-4ed1-bd80-7eaceb451bdd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:22.933495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7ecd52d0-33b3-4ed1-bd80-7eaceb451bdd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1273 microversion: 2.1 time: 0.142260 Sep 01 14:02:22.934118 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 84/160] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:22 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:23.955582 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a5a0202e-15e0-474b-85f5-0561c35194a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:23.955582 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a5a0202e-15e0-474b-85f5-0561c35194a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:23.969985 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a5a0202e-15e0-474b-85f5-0561c35194a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:23.970493 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a5a0202e-15e0-474b-85f5-0561c35194a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:23.970940 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a5a0202e-15e0-474b-85f5-0561c35194a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:23.971743 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a5a0202e-15e0-474b-85f5-0561c35194a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:23.972206 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a5a0202e-15e0-474b-85f5-0561c35194a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:23.972634 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a5a0202e-15e0-474b-85f5-0561c35194a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:24.086506 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a5a0202e-15e0-474b-85f5-0561c35194a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:24.094640 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a5a0202e-15e0-474b-85f5-0561c35194a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1279 microversion: 2.1 time: 0.143770 Sep 01 14:02:24.095138 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 77/161] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:23 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1279 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:24.926879 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-35973bf7-383b-4203-b299-e7860f4ce7fd req-d835b630-57a8-4a5e-8fd1-67588266f978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b03c776a-6615-43a6-88bd-58efe9736c7f", "tag": "4ec69dd1-60c6-4360-ac7d-4b40a6b43577"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:24.939173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-35973bf7-383b-4203-b299-e7860f4ce7fd req-d835b630-57a8-4a5e-8fd1-67588266f978 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:24.939891 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-35973bf7-383b-4203-b299-e7860f4ce7fd req-d835b630-57a8-4a5e-8fd1-67588266f978 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:24.940502 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-35973bf7-383b-4203-b299-e7860f4ce7fd req-d835b630-57a8-4a5e-8fd1-67588266f978 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:24.953729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-35973bf7-383b-4203-b299-e7860f4ce7fd req-d835b630-57a8-4a5e-8fd1-67588266f978 service nova] Creating event network-changed:4ec69dd1-60c6-4360-ac7d-4b40a6b43577 for instance b03c776a-6615-43a6-88bd-58efe9736c7f on hv-cinder-85221 Sep 01 14:02:24.960039 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-35973bf7-383b-4203-b299-e7860f4ce7fd req-d835b630-57a8-4a5e-8fd1-67588266f978 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036194 Sep 01 14:02:24.961982 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 85/162] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:25.116288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e5c49810-c429-426e-b4e4-eca58441c412 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:25.118213 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e5c49810-c429-426e-b4e4-eca58441c412 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:25.126200 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5c49810-c429-426e-b4e4-eca58441c412 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:25.126934 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5c49810-c429-426e-b4e4-eca58441c412 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:25.127686 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5c49810-c429-426e-b4e4-eca58441c412 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:25.128708 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5c49810-c429-426e-b4e4-eca58441c412 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:25.129427 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5c49810-c429-426e-b4e4-eca58441c412 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:25.130294 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5c49810-c429-426e-b4e4-eca58441c412 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:25.365972 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e5c49810-c429-426e-b4e4-eca58441c412 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:25.374831 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e5c49810-c429-426e-b4e4-eca58441c412 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1321 microversion: 2.1 time: 0.262645 Sep 01 14:02:25.375715 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 78/163] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:25 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1321 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:25.407769 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-f840ec5a-0782-40f6-addc-4950fd9f50ee req-385930d5-289c-4314-a4de-f1b3c7b7ad8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba", "tag": "634362b5-0f9b-4d48-aba3-d7ab3ca88dac"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:25.422065 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f840ec5a-0782-40f6-addc-4950fd9f50ee req-385930d5-289c-4314-a4de-f1b3c7b7ad8d service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:25.422688 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f840ec5a-0782-40f6-addc-4950fd9f50ee req-385930d5-289c-4314-a4de-f1b3c7b7ad8d service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:25.423124 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f840ec5a-0782-40f6-addc-4950fd9f50ee req-385930d5-289c-4314-a4de-f1b3c7b7ad8d service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:25.437698 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-f840ec5a-0782-40f6-addc-4950fd9f50ee req-385930d5-289c-4314-a4de-f1b3c7b7ad8d service nova] Creating event network-changed:634362b5-0f9b-4d48-aba3-d7ab3ca88dac for instance 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba on hv-cinder-85221 Sep 01 14:02:25.443115 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-f840ec5a-0782-40f6-addc-4950fd9f50ee req-385930d5-289c-4314-a4de-f1b3c7b7ad8d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039473 Sep 01 14:02:25.443832 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 86/164] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:26.395967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9cfebbd9-6ba0-40ae-80db-fd3b8974169d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:26.396938 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9cfebbd9-6ba0-40ae-80db-fd3b8974169d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:26.404601 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cfebbd9-6ba0-40ae-80db-fd3b8974169d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:26.405217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cfebbd9-6ba0-40ae-80db-fd3b8974169d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:26.405651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cfebbd9-6ba0-40ae-80db-fd3b8974169d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:26.406582 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cfebbd9-6ba0-40ae-80db-fd3b8974169d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:26.407238 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cfebbd9-6ba0-40ae-80db-fd3b8974169d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:26.407860 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cfebbd9-6ba0-40ae-80db-fd3b8974169d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:26.641101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9cfebbd9-6ba0-40ae-80db-fd3b8974169d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:26.649561 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9cfebbd9-6ba0-40ae-80db-fd3b8974169d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1321 microversion: 2.1 time: 0.258030 Sep 01 14:02:26.650172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 79/165] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:26 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:27.035925 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-fcb20f96-8b47-489d-becc-05c9ee8fa380 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:27.036665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-fcb20f96-8b47-489d-becc-05c9ee8fa380 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:27.045124 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fcb20f96-8b47-489d-becc-05c9ee8fa380 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:27.045693 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fcb20f96-8b47-489d-becc-05c9ee8fa380 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:27.046246 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fcb20f96-8b47-489d-becc-05c9ee8fa380 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:27.047065 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fcb20f96-8b47-489d-becc-05c9ee8fa380 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:27.047659 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fcb20f96-8b47-489d-becc-05c9ee8fa380 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:27.048284 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fcb20f96-8b47-489d-becc-05c9ee8fa380 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:27.080458 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-fcb20f96-8b47-489d-becc-05c9ee8fa380 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/ips" status: 200 len: 145 microversion: 2.1 time: 0.050399 Sep 01 14:02:27.081131 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 87/166] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 1 14:02:27 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/ips => generated 145 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:27.674404 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-aaeb915b-6bcf-41fa-9f91-b01960b65319 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:27.675200 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-aaeb915b-6bcf-41fa-9f91-b01960b65319 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:27.681586 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aaeb915b-6bcf-41fa-9f91-b01960b65319 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:27.682105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aaeb915b-6bcf-41fa-9f91-b01960b65319 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:27.682542 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aaeb915b-6bcf-41fa-9f91-b01960b65319 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:27.683507 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aaeb915b-6bcf-41fa-9f91-b01960b65319 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:27.684053 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aaeb915b-6bcf-41fa-9f91-b01960b65319 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:27.684803 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aaeb915b-6bcf-41fa-9f91-b01960b65319 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:27.822194 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-aaeb915b-6bcf-41fa-9f91-b01960b65319 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:27.830373 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-aaeb915b-6bcf-41fa-9f91-b01960b65319 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1321 microversion: 2.1 time: 0.159633 Sep 01 14:02:27.830873 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 80/167] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:27 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:28.853127 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1dc7e79e-6bbf-4936-a79a-55ecb7dfff48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:28.853815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1dc7e79e-6bbf-4936-a79a-55ecb7dfff48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:28.861181 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1dc7e79e-6bbf-4936-a79a-55ecb7dfff48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:28.861673 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1dc7e79e-6bbf-4936-a79a-55ecb7dfff48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:28.862233 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1dc7e79e-6bbf-4936-a79a-55ecb7dfff48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:28.863002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1dc7e79e-6bbf-4936-a79a-55ecb7dfff48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:28.863531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1dc7e79e-6bbf-4936-a79a-55ecb7dfff48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:28.864038 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1dc7e79e-6bbf-4936-a79a-55ecb7dfff48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:29.009346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1dc7e79e-6bbf-4936-a79a-55ecb7dfff48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:29.019830 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1dc7e79e-6bbf-4936-a79a-55ecb7dfff48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1321 microversion: 2.1 time: 0.171148 Sep 01 14:02:29.020559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 88/168] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:28 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:30.042604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-cc16e595-143f-410e-aa08-d973442ab623 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:30.046761 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-cc16e595-143f-410e-aa08-d973442ab623 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:30.046761 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=4 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:30.050656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc16e595-143f-410e-aa08-d973442ab623 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:30.051152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc16e595-143f-410e-aa08-d973442ab623 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:30.051591 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc16e595-143f-410e-aa08-d973442ab623 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:30.052302 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc16e595-143f-410e-aa08-d973442ab623 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:30.052754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc16e595-143f-410e-aa08-d973442ab623 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:30.053181 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc16e595-143f-410e-aa08-d973442ab623 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:30.220407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-cc16e595-143f-410e-aa08-d973442ab623 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:30.229652 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-cc16e595-143f-410e-aa08-d973442ab623 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1321 microversion: 2.1 time: 0.191468 Sep 01 14:02:30.237861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 81/169] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:30 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:30.926519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5886a48d-e7c6-4b07-930a-7fe7dfee0c26 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:30.927423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-5886a48d-e7c6-4b07-930a-7fe7dfee0c26 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:30.938071 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=4 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:30.939403 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=14 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:30.942489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5886a48d-e7c6-4b07-930a-7fe7dfee0c26 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:30.943449 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5886a48d-e7c6-4b07-930a-7fe7dfee0c26 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:30.944381 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5886a48d-e7c6-4b07-930a-7fe7dfee0c26 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:30.946213 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5886a48d-e7c6-4b07-930a-7fe7dfee0c26 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:30.947060 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5886a48d-e7c6-4b07-930a-7fe7dfee0c26 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:30.947792 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5886a48d-e7c6-4b07-930a-7fe7dfee0c26 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:31.002529 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-5886a48d-e7c6-4b07-930a-7fe7dfee0c26 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/ips" status: 200 len: 150 microversion: 2.20 time: 0.076872 Sep 01 14:02:31.013221 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 89/170] 10.222.0.61 () {60 vars in 1289 bytes} [Thu Sep 1 14:02:30 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/ips => generated 150 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:02:31.259470 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3bd391f5-72fb-4383-8f62-b9c4be492252 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:31.259470 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3bd391f5-72fb-4383-8f62-b9c4be492252 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:31.275680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3bd391f5-72fb-4383-8f62-b9c4be492252 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:31.276186 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3bd391f5-72fb-4383-8f62-b9c4be492252 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:31.276626 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3bd391f5-72fb-4383-8f62-b9c4be492252 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:31.277355 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3bd391f5-72fb-4383-8f62-b9c4be492252 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:31.277838 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3bd391f5-72fb-4383-8f62-b9c4be492252 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:31.278324 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3bd391f5-72fb-4383-8f62-b9c4be492252 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:31.496963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3bd391f5-72fb-4383-8f62-b9c4be492252 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:31.514305 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3bd391f5-72fb-4383-8f62-b9c4be492252 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1321 microversion: 2.1 time: 0.259798 Sep 01 14:02:31.515624 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 82/171] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:31 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:31.657243 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3c3c6dce-a756-42c6-8693-33e5f0d592a7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:31.660689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3c3c6dce-a756-42c6-8693-33e5f0d592a7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:31.665910 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3c3c6dce-a756-42c6-8693-33e5f0d592a7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:31.666466 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3c3c6dce-a756-42c6-8693-33e5f0d592a7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:31.666902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3c3c6dce-a756-42c6-8693-33e5f0d592a7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:31.667626 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3c3c6dce-a756-42c6-8693-33e5f0d592a7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:31.668077 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3c3c6dce-a756-42c6-8693-33e5f0d592a7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:31.668503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3c3c6dce-a756-42c6-8693-33e5f0d592a7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:31.698089 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3c3c6dce-a756-42c6-8693-33e5f0d592a7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/ips" status: 200 len: 151 microversion: 2.1 time: 0.044602 Sep 01 14:02:31.698671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 90/172] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 1 14:02:31 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:32.547493 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b9147a89-2f06-4c06-8eac-e17f7a78af0d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:32.547946 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b9147a89-2f06-4c06-8eac-e17f7a78af0d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:32.554551 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b9147a89-2f06-4c06-8eac-e17f7a78af0d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:32.555077 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b9147a89-2f06-4c06-8eac-e17f7a78af0d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:32.559127 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b9147a89-2f06-4c06-8eac-e17f7a78af0d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:32.559127 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b9147a89-2f06-4c06-8eac-e17f7a78af0d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:32.559127 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b9147a89-2f06-4c06-8eac-e17f7a78af0d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:32.559127 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b9147a89-2f06-4c06-8eac-e17f7a78af0d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:32.967628 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b9147a89-2f06-4c06-8eac-e17f7a78af0d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:32.975630 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b9147a89-2f06-4c06-8eac-e17f7a78af0d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1321 microversion: 2.1 time: 0.432039 Sep 01 14:02:32.976235 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 83/173] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:32 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:33.998334 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0d95eca7-6c16-4369-b380-d70f04b27c33 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:33.999934 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0d95eca7-6c16-4369-b380-d70f04b27c33 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:34.008288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0d95eca7-6c16-4369-b380-d70f04b27c33 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:34.008779 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0d95eca7-6c16-4369-b380-d70f04b27c33 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:34.009215 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0d95eca7-6c16-4369-b380-d70f04b27c33 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:34.009965 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0d95eca7-6c16-4369-b380-d70f04b27c33 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:34.010479 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0d95eca7-6c16-4369-b380-d70f04b27c33 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:34.010958 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0d95eca7-6c16-4369-b380-d70f04b27c33 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:34.146582 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0d95eca7-6c16-4369-b380-d70f04b27c33 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:34.154432 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0d95eca7-6c16-4369-b380-d70f04b27c33 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1321 microversion: 2.1 time: 0.161112 Sep 01 14:02:34.165563 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 91/174] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:33 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:34.843198 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ceb97951-09ce-4af7-b725-07311e12fee3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "901c84dc-0571-44e8-a50d-ed40ef86fc5f"}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:34.845749 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ceb97951-09ce-4af7-b725-07311e12fee3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:34.853586 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ceb97951-09ce-4af7-b725-07311e12fee3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:34.854321 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ceb97951-09ce-4af7-b725-07311e12fee3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:34.854963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ceb97951-09ce-4af7-b725-07311e12fee3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:34.855810 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ceb97951-09ce-4af7-b725-07311e12fee3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:34.856387 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ceb97951-09ce-4af7-b725-07311e12fee3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:34.857064 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ceb97951-09ce-4af7-b725-07311e12fee3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:34.890683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-419f0b09-d615-468a-b711-141b45c047c2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "164d3bed-2366-46d9-a136-3778741c0854"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:34.893297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-419f0b09-d615-468a-b711-141b45c047c2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:34.926226 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-419f0b09-d615-468a-b711-141b45c047c2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:34.926226 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-419f0b09-d615-468a-b711-141b45c047c2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:34.926226 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-419f0b09-d615-468a-b711-141b45c047c2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:34.926226 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-419f0b09-d615-468a-b711-141b45c047c2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:34.926656 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-419f0b09-d615-468a-b711-141b45c047c2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:34.926656 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-419f0b09-d615-468a-b711-141b45c047c2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:35.972563 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ceb97951-09ce-4af7-b725-07311e12fee3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "POST /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.133152 Sep 01 14:02:35.979223 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 84/175] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:02:34 2022] POST /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/os-volume_attachments => generated 194 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:35.986884 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-91eb9809-ea95-4ba2-ad42-37fc87d9ced9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:35.987966 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-91eb9809-ea95-4ba2-ad42-37fc87d9ced9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:35.996294 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91eb9809-ea95-4ba2-ad42-37fc87d9ced9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:35.997144 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91eb9809-ea95-4ba2-ad42-37fc87d9ced9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:35.997916 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91eb9809-ea95-4ba2-ad42-37fc87d9ced9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:35.998912 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91eb9809-ea95-4ba2-ad42-37fc87d9ced9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:35.999613 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91eb9809-ea95-4ba2-ad42-37fc87d9ced9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:36.000497 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91eb9809-ea95-4ba2-ad42-37fc87d9ced9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:36.207177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-419f0b09-d615-468a-b711-141b45c047c2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "POST /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.320555 Sep 01 14:02:36.208619 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 92/176] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:02:34 2022] POST /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments => generated 194 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:36.219604 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-57aa4ee4-04c6-47c7-9b56-23ceb76f0de6 req-4c3751d9-99c7-4a17-8537-216a8a9c6472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b03c776a-6615-43a6-88bd-58efe9736c7f", "name": "network-vif-plugged", "status": "completed", "tag": "4ec69dd1-60c6-4360-ac7d-4b40a6b43577"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:36.239697 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-57aa4ee4-04c6-47c7-9b56-23ceb76f0de6 req-4c3751d9-99c7-4a17-8537-216a8a9c6472 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:36.240485 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-57aa4ee4-04c6-47c7-9b56-23ceb76f0de6 req-4c3751d9-99c7-4a17-8537-216a8a9c6472 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:36.241065 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-57aa4ee4-04c6-47c7-9b56-23ceb76f0de6 req-4c3751d9-99c7-4a17-8537-216a8a9c6472 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:36.254421 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-57aa4ee4-04c6-47c7-9b56-23ceb76f0de6 req-4c3751d9-99c7-4a17-8537-216a8a9c6472 service nova] Creating event network-vif-plugged:4ec69dd1-60c6-4360-ac7d-4b40a6b43577 for instance b03c776a-6615-43a6-88bd-58efe9736c7f on hv-cinder-85221 Sep 01 14:02:36.261554 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-57aa4ee4-04c6-47c7-9b56-23ceb76f0de6 req-4c3751d9-99c7-4a17-8537-216a8a9c6472 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050683 Sep 01 14:02:36.262670 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 93/177] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:36.268021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-91eb9809-ea95-4ba2-ad42-37fc87d9ced9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:36.269671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e3937e52-18b2-4b91-9fc3-25b938d67509 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:36.270539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e3937e52-18b2-4b91-9fc3-25b938d67509 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:36.283727 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-91eb9809-ea95-4ba2-ad42-37fc87d9ced9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1321 microversion: 2.1 time: 0.302744 Sep 01 14:02:36.284431 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 85/178] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:35 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:36.286225 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e3937e52-18b2-4b91-9fc3-25b938d67509 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:36.286990 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e3937e52-18b2-4b91-9fc3-25b938d67509 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:36.287475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e3937e52-18b2-4b91-9fc3-25b938d67509 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:36.288367 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e3937e52-18b2-4b91-9fc3-25b938d67509 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:36.289457 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e3937e52-18b2-4b91-9fc3-25b938d67509 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:36.290135 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e3937e52-18b2-4b91-9fc3-25b938d67509 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:36.320908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-e3937e52-18b2-4b91-9fc3-25b938d67509 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lazy-loading 'flavor' on Instance uuid 0bac5a33-d73f-48a4-bead-fcf039becf3a {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:02:36.990464 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e3937e52-18b2-4b91-9fc3-25b938d67509 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "POST /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/action" status: 202 len: 0 microversion: 2.20 time: 0.725857 Sep 01 14:02:36.991067 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 94/179] 10.222.0.61 () {62 vars in 1319 bytes} [Thu Sep 1 14:02:36 2022] POST /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/action => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:02:37.000825 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-cd7d3729-883c-43dc-86b8-0f41c296ea6d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:37.002312 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-cd7d3729-883c-43dc-86b8-0f41c296ea6d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:37.012425 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cd7d3729-883c-43dc-86b8-0f41c296ea6d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:37.012999 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cd7d3729-883c-43dc-86b8-0f41c296ea6d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:37.013447 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cd7d3729-883c-43dc-86b8-0f41c296ea6d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:37.014492 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cd7d3729-883c-43dc-86b8-0f41c296ea6d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:37.016566 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cd7d3729-883c-43dc-86b8-0f41c296ea6d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:37.016566 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cd7d3729-883c-43dc-86b8-0f41c296ea6d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:37.172348 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-cd7d3729-883c-43dc-86b8-0f41c296ea6d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:37.183630 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-cd7d3729-883c-43dc-86b8-0f41c296ea6d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:37.185539 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-cd7d3729-883c-43dc-86b8-0f41c296ea6d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:37.187295 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-cd7d3729-883c-43dc-86b8-0f41c296ea6d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.190899 Sep 01 14:02:37.187720 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 86/180] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:36 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:37.305724 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-dc18529c-33cd-450e-a553-198bc7a0c11f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:37.306139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-dc18529c-33cd-450e-a553-198bc7a0c11f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:37.312710 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc18529c-33cd-450e-a553-198bc7a0c11f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:37.313200 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc18529c-33cd-450e-a553-198bc7a0c11f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:37.314698 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc18529c-33cd-450e-a553-198bc7a0c11f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:37.316198 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc18529c-33cd-450e-a553-198bc7a0c11f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:37.316827 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc18529c-33cd-450e-a553-198bc7a0c11f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:37.317440 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc18529c-33cd-450e-a553-198bc7a0c11f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:37.508947 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-dc18529c-33cd-450e-a553-198bc7a0c11f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:37.522667 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-dc18529c-33cd-450e-a553-198bc7a0c11f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1321 microversion: 2.1 time: 0.221401 Sep 01 14:02:37.551320 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 95/181] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:37 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:38.218551 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0d956f7e-842e-44c2-b605-ceb9fdb85278 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:38.219090 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0d956f7e-842e-44c2-b605-ceb9fdb85278 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:38.229267 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0d956f7e-842e-44c2-b605-ceb9fdb85278 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:38.229781 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0d956f7e-842e-44c2-b605-ceb9fdb85278 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:38.230262 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0d956f7e-842e-44c2-b605-ceb9fdb85278 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:38.230979 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0d956f7e-842e-44c2-b605-ceb9fdb85278 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:38.231463 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0d956f7e-842e-44c2-b605-ceb9fdb85278 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:38.231890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0d956f7e-842e-44c2-b605-ceb9fdb85278 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:38.287904 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-98a13369-8ecc-4ffa-a888-c281ba4f61e8 req-34dc9943-e15d-427b-a8dd-bca0460a72a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba", "name": "network-vif-plugged", "status": "completed", "tag": "634362b5-0f9b-4d48-aba3-d7ab3ca88dac"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:38.301645 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-98a13369-8ecc-4ffa-a888-c281ba4f61e8 req-34dc9943-e15d-427b-a8dd-bca0460a72a9 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:38.302503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-98a13369-8ecc-4ffa-a888-c281ba4f61e8 req-34dc9943-e15d-427b-a8dd-bca0460a72a9 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:38.303194 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-98a13369-8ecc-4ffa-a888-c281ba4f61e8 req-34dc9943-e15d-427b-a8dd-bca0460a72a9 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:38.317413 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-98a13369-8ecc-4ffa-a888-c281ba4f61e8 req-34dc9943-e15d-427b-a8dd-bca0460a72a9 service nova] Creating event network-vif-plugged:634362b5-0f9b-4d48-aba3-d7ab3ca88dac for instance 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba on hv-cinder-85221 Sep 01 14:02:38.324216 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-98a13369-8ecc-4ffa-a888-c281ba4f61e8 req-34dc9943-e15d-427b-a8dd-bca0460a72a9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041208 Sep 01 14:02:38.324824 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 96/182] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:38.397218 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0d956f7e-842e-44c2-b605-ceb9fdb85278 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:38.406857 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0d956f7e-842e-44c2-b605-ceb9fdb85278 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:38.408334 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0d956f7e-842e-44c2-b605-ceb9fdb85278 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:38.409668 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0d956f7e-842e-44c2-b605-ceb9fdb85278 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.195781 Sep 01 14:02:38.410284 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 87/183] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:38 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:38.549408 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-605572ea-251c-4e37-bb8d-814c71158f44 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:38.550515 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-605572ea-251c-4e37-bb8d-814c71158f44 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:38.558835 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-605572ea-251c-4e37-bb8d-814c71158f44 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:38.559674 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-605572ea-251c-4e37-bb8d-814c71158f44 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:38.560701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-605572ea-251c-4e37-bb8d-814c71158f44 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:38.561919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-605572ea-251c-4e37-bb8d-814c71158f44 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:38.562574 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-605572ea-251c-4e37-bb8d-814c71158f44 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:38.563858 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-605572ea-251c-4e37-bb8d-814c71158f44 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:38.735869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-605572ea-251c-4e37-bb8d-814c71158f44 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:38.746646 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-605572ea-251c-4e37-bb8d-814c71158f44 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1321 microversion: 2.1 time: 0.205029 Sep 01 14:02:38.747232 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 97/184] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:38 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:39.434461 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-986af7d0-a8e1-4ac0-b21c-5f6735addf94 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:39.435665 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-986af7d0-a8e1-4ac0-b21c-5f6735addf94 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:39.443942 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-986af7d0-a8e1-4ac0-b21c-5f6735addf94 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:39.444490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-986af7d0-a8e1-4ac0-b21c-5f6735addf94 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:39.444980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-986af7d0-a8e1-4ac0-b21c-5f6735addf94 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:39.446276 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-986af7d0-a8e1-4ac0-b21c-5f6735addf94 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:39.447289 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-986af7d0-a8e1-4ac0-b21c-5f6735addf94 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:39.447478 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-986af7d0-a8e1-4ac0-b21c-5f6735addf94 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:39.644728 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-986af7d0-a8e1-4ac0-b21c-5f6735addf94 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:39.667111 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-986af7d0-a8e1-4ac0-b21c-5f6735addf94 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:39.672132 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-986af7d0-a8e1-4ac0-b21c-5f6735addf94 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:39.672132 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-986af7d0-a8e1-4ac0-b21c-5f6735addf94 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.239870 Sep 01 14:02:39.672132 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 88/185] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:39 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:39.770935 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0f301dec-240a-45cf-8192-a4c8f5f8fb5d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:39.772187 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0f301dec-240a-45cf-8192-a4c8f5f8fb5d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:39.779487 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0f301dec-240a-45cf-8192-a4c8f5f8fb5d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:39.780222 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0f301dec-240a-45cf-8192-a4c8f5f8fb5d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:39.780806 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0f301dec-240a-45cf-8192-a4c8f5f8fb5d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:39.781657 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0f301dec-240a-45cf-8192-a4c8f5f8fb5d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:39.782419 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0f301dec-240a-45cf-8192-a4c8f5f8fb5d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:39.782843 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0f301dec-240a-45cf-8192-a4c8f5f8fb5d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:39.932022 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0f301dec-240a-45cf-8192-a4c8f5f8fb5d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:39.940349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0f301dec-240a-45cf-8192-a4c8f5f8fb5d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1321 microversion: 2.1 time: 0.175416 Sep 01 14:02:39.941028 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 98/186] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:39 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:40.699413 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-37c4e2f6-be9c-4d69-8472-b09322150365 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:40.701586 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-37c4e2f6-be9c-4d69-8472-b09322150365 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:40.713340 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-37c4e2f6-be9c-4d69-8472-b09322150365 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:40.714536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-37c4e2f6-be9c-4d69-8472-b09322150365 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:40.715626 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-37c4e2f6-be9c-4d69-8472-b09322150365 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:40.716903 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-37c4e2f6-be9c-4d69-8472-b09322150365 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:40.717962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-37c4e2f6-be9c-4d69-8472-b09322150365 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:40.718782 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-37c4e2f6-be9c-4d69-8472-b09322150365 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:40.893029 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-37c4e2f6-be9c-4d69-8472-b09322150365 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:40.901902 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-37c4e2f6-be9c-4d69-8472-b09322150365 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:40.920468 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-37c4e2f6-be9c-4d69-8472-b09322150365 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:40.920468 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-37c4e2f6-be9c-4d69-8472-b09322150365 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.212799 Sep 01 14:02:40.920468 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 89/187] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:40 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:40.962410 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2c95dd5b-cafb-4171-b224-5f3cbd4a1e30 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:40.963077 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2c95dd5b-cafb-4171-b224-5f3cbd4a1e30 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:40.969622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2c95dd5b-cafb-4171-b224-5f3cbd4a1e30 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:40.970141 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2c95dd5b-cafb-4171-b224-5f3cbd4a1e30 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:40.970621 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2c95dd5b-cafb-4171-b224-5f3cbd4a1e30 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:40.971385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2c95dd5b-cafb-4171-b224-5f3cbd4a1e30 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:40.971854 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2c95dd5b-cafb-4171-b224-5f3cbd4a1e30 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:40.972280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2c95dd5b-cafb-4171-b224-5f3cbd4a1e30 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:41.117284 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2c95dd5b-cafb-4171-b224-5f3cbd4a1e30 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:41.125446 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2c95dd5b-cafb-4171-b224-5f3cbd4a1e30 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1321 microversion: 2.1 time: 0.167092 Sep 01 14:02:41.126175 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 99/188] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:40 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:41.927246 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8cdae93c-d317-4821-afed-c06a340aaef0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:41.927886 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8cdae93c-d317-4821-afed-c06a340aaef0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:41.934098 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8cdae93c-d317-4821-afed-c06a340aaef0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:41.934573 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8cdae93c-d317-4821-afed-c06a340aaef0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:41.935006 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8cdae93c-d317-4821-afed-c06a340aaef0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:41.935765 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8cdae93c-d317-4821-afed-c06a340aaef0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:41.936206 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8cdae93c-d317-4821-afed-c06a340aaef0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:41.936618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8cdae93c-d317-4821-afed-c06a340aaef0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:42.122244 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8cdae93c-d317-4821-afed-c06a340aaef0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:42.130742 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8cdae93c-d317-4821-afed-c06a340aaef0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:42.132911 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8cdae93c-d317-4821-afed-c06a340aaef0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:42.134140 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8cdae93c-d317-4821-afed-c06a340aaef0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.210752 Sep 01 14:02:42.135072 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 90/189] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:41 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:42.156831 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0e127457-9619-4725-98b7-1608b77c5766 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:42.156831 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0e127457-9619-4725-98b7-1608b77c5766 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:42.163643 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0e127457-9619-4725-98b7-1608b77c5766 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:42.164485 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0e127457-9619-4725-98b7-1608b77c5766 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:42.165134 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0e127457-9619-4725-98b7-1608b77c5766 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:42.172908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0e127457-9619-4725-98b7-1608b77c5766 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:42.172908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0e127457-9619-4725-98b7-1608b77c5766 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:42.172908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0e127457-9619-4725-98b7-1608b77c5766 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:42.172908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:42.307195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0e127457-9619-4725-98b7-1608b77c5766 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:42.315401 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0e127457-9619-4725-98b7-1608b77c5766 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1516 microversion: 2.1 time: 0.164388 Sep 01 14:02:42.315837 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 100/190] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:42 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:42.336168 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-977981ab-ad45-4c22-a6c8-8987f93f33be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:42.338461 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-977981ab-ad45-4c22-a6c8-8987f93f33be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:42.344403 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-977981ab-ad45-4c22-a6c8-8987f93f33be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:42.344888 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-977981ab-ad45-4c22-a6c8-8987f93f33be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:42.345323 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-977981ab-ad45-4c22-a6c8-8987f93f33be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:42.346032 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-977981ab-ad45-4c22-a6c8-8987f93f33be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:42.346485 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-977981ab-ad45-4c22-a6c8-8987f93f33be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:42.346906 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-977981ab-ad45-4c22-a6c8-8987f93f33be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:42.351681 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:42.371282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-977981ab-ad45-4c22-a6c8-8987f93f33be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'flavor' on Instance uuid 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:02:42.772998 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-977981ab-ad45-4c22-a6c8-8987f93f33be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "POST /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba/action" status: 200 len: 32 microversion: 2.1 time: 0.435508 Sep 01 14:02:42.772998 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 91/191] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:02:42 2022] POST /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba/action => generated 32 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:02:42.780165 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f962759d-0ad3-483b-b95d-632bcd71d83d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:42.781450 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f962759d-0ad3-483b-b95d-632bcd71d83d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:42.792142 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f962759d-0ad3-483b-b95d-632bcd71d83d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:42.792894 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f962759d-0ad3-483b-b95d-632bcd71d83d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:42.793935 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f962759d-0ad3-483b-b95d-632bcd71d83d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:42.795081 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f962759d-0ad3-483b-b95d-632bcd71d83d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:42.796095 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f962759d-0ad3-483b-b95d-632bcd71d83d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:42.796898 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f962759d-0ad3-483b-b95d-632bcd71d83d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:42.979683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f962759d-0ad3-483b-b95d-632bcd71d83d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:42.987940 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f962759d-0ad3-483b-b95d-632bcd71d83d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.213768 Sep 01 14:02:42.989228 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 101/192] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:42 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:43.159337 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f8a2cabd-31a6-4c69-9655-1f75983aba9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:43.160234 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f8a2cabd-31a6-4c69-9655-1f75983aba9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:43.175256 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f8a2cabd-31a6-4c69-9655-1f75983aba9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:43.175859 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f8a2cabd-31a6-4c69-9655-1f75983aba9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:43.176595 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f8a2cabd-31a6-4c69-9655-1f75983aba9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:43.177479 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f8a2cabd-31a6-4c69-9655-1f75983aba9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:43.178035 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f8a2cabd-31a6-4c69-9655-1f75983aba9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:43.179106 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f8a2cabd-31a6-4c69-9655-1f75983aba9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:43.404954 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f8a2cabd-31a6-4c69-9655-1f75983aba9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:43.404954 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f8a2cabd-31a6-4c69-9655-1f75983aba9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:43.407329 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f8a2cabd-31a6-4c69-9655-1f75983aba9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:43.407329 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f8a2cabd-31a6-4c69-9655-1f75983aba9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.184045 Sep 01 14:02:43.407329 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 92/193] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:43 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:44.010818 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ac906f6e-08ea-4d6c-940c-b7d3624b18fa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:44.017886 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ac906f6e-08ea-4d6c-940c-b7d3624b18fa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:44.020629 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ac906f6e-08ea-4d6c-940c-b7d3624b18fa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:44.021121 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ac906f6e-08ea-4d6c-940c-b7d3624b18fa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:44.021560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ac906f6e-08ea-4d6c-940c-b7d3624b18fa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:44.022284 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ac906f6e-08ea-4d6c-940c-b7d3624b18fa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:44.022921 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ac906f6e-08ea-4d6c-940c-b7d3624b18fa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:44.023352 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ac906f6e-08ea-4d6c-940c-b7d3624b18fa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:44.180088 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ac906f6e-08ea-4d6c-940c-b7d3624b18fa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:44.189933 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ac906f6e-08ea-4d6c-940c-b7d3624b18fa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.183570 Sep 01 14:02:44.204223 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 102/194] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:44 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:44.420098 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f93eb608-f598-4728-88e3-d1b3b6ca6e3a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:44.420700 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f93eb608-f598-4728-88e3-d1b3b6ca6e3a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:44.427752 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f93eb608-f598-4728-88e3-d1b3b6ca6e3a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:44.428244 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f93eb608-f598-4728-88e3-d1b3b6ca6e3a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:44.428673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f93eb608-f598-4728-88e3-d1b3b6ca6e3a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:44.429901 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f93eb608-f598-4728-88e3-d1b3b6ca6e3a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:44.430349 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f93eb608-f598-4728-88e3-d1b3b6ca6e3a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:44.430769 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f93eb608-f598-4728-88e3-d1b3b6ca6e3a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:44.610121 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f93eb608-f598-4728-88e3-d1b3b6ca6e3a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:44.622422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f93eb608-f598-4728-88e3-d1b3b6ca6e3a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:44.623903 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f93eb608-f598-4728-88e3-d1b3b6ca6e3a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:44.625602 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f93eb608-f598-4728-88e3-d1b3b6ca6e3a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.209573 Sep 01 14:02:44.626817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 93/195] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:44 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:45.227683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0ad286bb-c01a-46ba-b2aa-85b586e2c139 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:45.229395 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0ad286bb-c01a-46ba-b2aa-85b586e2c139 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:45.239219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ad286bb-c01a-46ba-b2aa-85b586e2c139 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:45.240501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ad286bb-c01a-46ba-b2aa-85b586e2c139 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:45.241171 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ad286bb-c01a-46ba-b2aa-85b586e2c139 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:45.242622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ad286bb-c01a-46ba-b2aa-85b586e2c139 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:45.244431 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ad286bb-c01a-46ba-b2aa-85b586e2c139 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:45.244981 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ad286bb-c01a-46ba-b2aa-85b586e2c139 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:45.271167 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e02ab889-7454-439f-9622-b4c6ba5d1e87 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:45.278316 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e02ab889-7454-439f-9622-b4c6ba5d1e87 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:45.281200 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e02ab889-7454-439f-9622-b4c6ba5d1e87 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:45.281893 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e02ab889-7454-439f-9622-b4c6ba5d1e87 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:45.356585 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e02ab889-7454-439f-9622-b4c6ba5d1e87 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Going to try to stop instance {{(pid=127812) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 14:02:45.516983 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0ad286bb-c01a-46ba-b2aa-85b586e2c139 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:45.528819 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0ad286bb-c01a-46ba-b2aa-85b586e2c139 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.308972 Sep 01 14:02:45.529431 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 103/196] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:45 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:45.540904 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e02ab889-7454-439f-9622-b4c6ba5d1e87 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "POST /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/action" status: 202 len: 0 microversion: 2.1 time: 0.275750 Sep 01 14:02:45.544878 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 94/197] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:02:45 2022] POST /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:02:45.550123 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-554f25b8-db37-4ab8-8c89-17a74afa8dd9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:45.550744 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-554f25b8-db37-4ab8-8c89-17a74afa8dd9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:45.567328 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-554f25b8-db37-4ab8-8c89-17a74afa8dd9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:45.568272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-554f25b8-db37-4ab8-8c89-17a74afa8dd9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:45.569001 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-554f25b8-db37-4ab8-8c89-17a74afa8dd9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:45.570007 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-554f25b8-db37-4ab8-8c89-17a74afa8dd9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:45.570656 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-554f25b8-db37-4ab8-8c89-17a74afa8dd9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:45.571237 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-554f25b8-db37-4ab8-8c89-17a74afa8dd9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:45.652313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-cc0ef272-2df6-4896-a6f6-4c69eb79318d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:45.652947 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-cc0ef272-2df6-4896-a6f6-4c69eb79318d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:45.662202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc0ef272-2df6-4896-a6f6-4c69eb79318d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:45.662942 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc0ef272-2df6-4896-a6f6-4c69eb79318d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:45.663843 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc0ef272-2df6-4896-a6f6-4c69eb79318d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:45.665100 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc0ef272-2df6-4896-a6f6-4c69eb79318d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:45.665736 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc0ef272-2df6-4896-a6f6-4c69eb79318d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:45.666191 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc0ef272-2df6-4896-a6f6-4c69eb79318d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:45.834289 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-554f25b8-db37-4ab8-8c89-17a74afa8dd9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:45.850480 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-554f25b8-db37-4ab8-8c89-17a74afa8dd9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.304168 Sep 01 14:02:45.852260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 104/198] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:45 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:45.906850 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-cc0ef272-2df6-4896-a6f6-4c69eb79318d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:45.933441 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-cc0ef272-2df6-4896-a6f6-4c69eb79318d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:45.934950 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-cc0ef272-2df6-4896-a6f6-4c69eb79318d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:45.936148 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-cc0ef272-2df6-4896-a6f6-4c69eb79318d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.289027 Sep 01 14:02:45.936718 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 95/199] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:45 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:02:46.552278 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-14bad826-7f5f-4b74-8d19-93ddf37d8f41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:46.553190 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-14bad826-7f5f-4b74-8d19-93ddf37d8f41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:46.564510 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-14bad826-7f5f-4b74-8d19-93ddf37d8f41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:46.565551 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-14bad826-7f5f-4b74-8d19-93ddf37d8f41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:46.567144 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-14bad826-7f5f-4b74-8d19-93ddf37d8f41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:46.568835 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-14bad826-7f5f-4b74-8d19-93ddf37d8f41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:46.573243 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-14bad826-7f5f-4b74-8d19-93ddf37d8f41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:46.578826 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-14bad826-7f5f-4b74-8d19-93ddf37d8f41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:46.735922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-14bad826-7f5f-4b74-8d19-93ddf37d8f41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:46.752223 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-14bad826-7f5f-4b74-8d19-93ddf37d8f41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.199204 Sep 01 14:02:46.752890 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 105/200] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:46 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:46.873733 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-074029e6-53a2-4701-9031-ae260dce734f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:46.874368 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-074029e6-53a2-4701-9031-ae260dce734f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:46.880744 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-074029e6-53a2-4701-9031-ae260dce734f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:46.881223 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-074029e6-53a2-4701-9031-ae260dce734f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:46.881686 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-074029e6-53a2-4701-9031-ae260dce734f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:46.883069 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-074029e6-53a2-4701-9031-ae260dce734f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:46.883526 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-074029e6-53a2-4701-9031-ae260dce734f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:46.883951 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-074029e6-53a2-4701-9031-ae260dce734f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:46.960570 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-903d2d70-2a3c-4742-a43e-b2f9510590a3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:46.961428 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-903d2d70-2a3c-4742-a43e-b2f9510590a3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:46.970718 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-903d2d70-2a3c-4742-a43e-b2f9510590a3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:46.970718 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-903d2d70-2a3c-4742-a43e-b2f9510590a3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:46.973817 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-903d2d70-2a3c-4742-a43e-b2f9510590a3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:46.974827 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-903d2d70-2a3c-4742-a43e-b2f9510590a3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:46.975307 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-903d2d70-2a3c-4742-a43e-b2f9510590a3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:46.975903 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-903d2d70-2a3c-4742-a43e-b2f9510590a3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:47.042663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-074029e6-53a2-4701-9031-ae260dce734f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:47.052980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-074029e6-53a2-4701-9031-ae260dce734f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.183400 Sep 01 14:02:47.054625 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 96/201] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:46 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:47.243594 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-903d2d70-2a3c-4742-a43e-b2f9510590a3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:47.255517 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-903d2d70-2a3c-4742-a43e-b2f9510590a3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:47.255517 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-903d2d70-2a3c-4742-a43e-b2f9510590a3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:47.255517 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-903d2d70-2a3c-4742-a43e-b2f9510590a3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.299120 Sep 01 14:02:47.255952 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 106/202] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:46 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:02:47.773611 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-78b27456-b6a1-40c8-a626-cd87bddbddb1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:47.774493 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-78b27456-b6a1-40c8-a626-cd87bddbddb1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:47.781123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78b27456-b6a1-40c8-a626-cd87bddbddb1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:47.781691 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78b27456-b6a1-40c8-a626-cd87bddbddb1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:47.782484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78b27456-b6a1-40c8-a626-cd87bddbddb1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:47.783190 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78b27456-b6a1-40c8-a626-cd87bddbddb1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:47.783646 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78b27456-b6a1-40c8-a626-cd87bddbddb1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:47.784263 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78b27456-b6a1-40c8-a626-cd87bddbddb1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:48.078119 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f49929bd-27bd-4431-934d-512da0758b8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:48.078838 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f49929bd-27bd-4431-934d-512da0758b8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:48.081171 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:48.086733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f49929bd-27bd-4431-934d-512da0758b8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:48.087394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f49929bd-27bd-4431-934d-512da0758b8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:48.087900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-78b27456-b6a1-40c8-a626-cd87bddbddb1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:48.088663 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f49929bd-27bd-4431-934d-512da0758b8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:48.089709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f49929bd-27bd-4431-934d-512da0758b8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:48.090479 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f49929bd-27bd-4431-934d-512da0758b8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:48.091089 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f49929bd-27bd-4431-934d-512da0758b8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:48.100369 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-78b27456-b6a1-40c8-a626-cd87bddbddb1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.331258 Sep 01 14:02:48.107514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 97/203] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:47 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:48.246695 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f49929bd-27bd-4431-934d-512da0758b8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:48.250946 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f49929bd-27bd-4431-934d-512da0758b8a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.176515 Sep 01 14:02:48.251565 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 107/204] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:48 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:48.277880 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-fdd56502-9175-4dd5-9ae6-7e0d0737ad16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:48.279225 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fdd56502-9175-4dd5-9ae6-7e0d0737ad16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:48.291489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fdd56502-9175-4dd5-9ae6-7e0d0737ad16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:48.294721 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fdd56502-9175-4dd5-9ae6-7e0d0737ad16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:48.294721 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fdd56502-9175-4dd5-9ae6-7e0d0737ad16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:48.294721 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fdd56502-9175-4dd5-9ae6-7e0d0737ad16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:48.294721 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fdd56502-9175-4dd5-9ae6-7e0d0737ad16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:48.295067 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fdd56502-9175-4dd5-9ae6-7e0d0737ad16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:48.490872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1076491975", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "networks": [{"uuid": "2084e95d-fd58-4d52-9363-b07e0b5a21ae"}]}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:48.498634 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fdd56502-9175-4dd5-9ae6-7e0d0737ad16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:48.515247 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fdd56502-9175-4dd5-9ae6-7e0d0737ad16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:48.519708 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fdd56502-9175-4dd5-9ae6-7e0d0737ad16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:48.521985 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-fdd56502-9175-4dd5-9ae6-7e0d0737ad16 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.248879 Sep 01 14:02:48.523085 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 98/205] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:48 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:48.561671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.network.neutron [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] validate_networks() for [('2084e95d-fd58-4d52-9363-b07e0b5a21ae', None, None, None, None, None)] {{(pid=127811) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:02:48.950610 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Flavor limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:02:48.951034 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Image limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:02:48.951542 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Flavor pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:02:48.951946 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Image pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:02:48.952357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:02:48.963948 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:48.964539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:48.964853 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:48.965612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:48.966101 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:48.966510 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:48.986857 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Getting quotas for project 596cdff155be4dc997ce351b7cd6db08. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:02:48.992515 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Getting quotas for user 9c60f6eaccad440abff863fe99b40382 and project 596cdff155be4dc997ce351b7cd6db08. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:02:49.006674 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Going to run 1 instances... {{(pid=127811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:02:49.007965 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:02:49.123115 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b717b0b2-6812-4f9a-969d-c93b9e6fd177 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:49.123848 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b717b0b2-6812-4f9a-969d-c93b9e6fd177 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:49.130794 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b717b0b2-6812-4f9a-969d-c93b9e6fd177 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:49.131291 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b717b0b2-6812-4f9a-969d-c93b9e6fd177 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:49.131735 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b717b0b2-6812-4f9a-969d-c93b9e6fd177 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:49.133019 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b717b0b2-6812-4f9a-969d-c93b9e6fd177 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:49.133481 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b717b0b2-6812-4f9a-969d-c93b9e6fd177 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:49.133945 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b717b0b2-6812-4f9a-969d-c93b9e6fd177 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:49.166289 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b7d633f4-5321-4a38-97d9-0e6ee7c6caf2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680737 Sep 01 14:02:49.179837 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 108/206] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:02:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:02:49.191846 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a9f14d23-5689-493b-b7e6-7f773fc5ecb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:49.192776 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a9f14d23-5689-493b-b7e6-7f773fc5ecb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:49.266646 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a9f14d23-5689-493b-b7e6-7f773fc5ecb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:49.283393 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a9f14d23-5689-493b-b7e6-7f773fc5ecb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1214 microversion: 2.1 time: 0.094909 Sep 01 14:02:49.284591 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 109/207] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:49 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:49.296989 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4df3a229-cbc6-404f-9c2f-3e5c7f02008b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:49.297677 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4df3a229-cbc6-404f-9c2f-3e5c7f02008b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:49.324542 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4df3a229-cbc6-404f-9c2f-3e5c7f02008b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:49.325913 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4df3a229-cbc6-404f-9c2f-3e5c7f02008b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:49.326390 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4df3a229-cbc6-404f-9c2f-3e5c7f02008b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:49.327190 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4df3a229-cbc6-404f-9c2f-3e5c7f02008b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:49.327676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4df3a229-cbc6-404f-9c2f-3e5c7f02008b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:49.328105 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4df3a229-cbc6-404f-9c2f-3e5c7f02008b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:49.342626 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b717b0b2-6812-4f9a-969d-c93b9e6fd177 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:49.351570 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b717b0b2-6812-4f9a-969d-c93b9e6fd177 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.232319 Sep 01 14:02:49.352151 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 99/208] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:49 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:49.489677 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4df3a229-cbc6-404f-9c2f-3e5c7f02008b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:49.498944 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4df3a229-cbc6-404f-9c2f-3e5c7f02008b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.212392 Sep 01 14:02:49.498944 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 110/209] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:49 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:49.545479 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-601e6e2e-f3ce-4d9f-961f-a0bdc57ebc6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:49.546172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-601e6e2e-f3ce-4d9f-961f-a0bdc57ebc6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:49.553169 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-601e6e2e-f3ce-4d9f-961f-a0bdc57ebc6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:49.557284 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-601e6e2e-f3ce-4d9f-961f-a0bdc57ebc6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:49.557284 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-601e6e2e-f3ce-4d9f-961f-a0bdc57ebc6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:49.557284 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-601e6e2e-f3ce-4d9f-961f-a0bdc57ebc6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:49.557284 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-601e6e2e-f3ce-4d9f-961f-a0bdc57ebc6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:49.557623 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-601e6e2e-f3ce-4d9f-961f-a0bdc57ebc6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:49.692442 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-601e6e2e-f3ce-4d9f-961f-a0bdc57ebc6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:49.701676 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-601e6e2e-f3ce-4d9f-961f-a0bdc57ebc6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:49.703203 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-601e6e2e-f3ce-4d9f-961f-a0bdc57ebc6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:49.704490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-601e6e2e-f3ce-4d9f-961f-a0bdc57ebc6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.163140 Sep 01 14:02:49.705055 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 100/210] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:49 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:50.307423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-254f5326-38ad-4b5d-91aa-b9df0f12a95c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:50.308535 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-254f5326-38ad-4b5d-91aa-b9df0f12a95c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:50.373306 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1238fa92-f8c7-4719-8deb-3b2ed2f7b556 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:50.374550 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1238fa92-f8c7-4719-8deb-3b2ed2f7b556 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:50.379207 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-254f5326-38ad-4b5d-91aa-b9df0f12a95c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:50.396336 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1238fa92-f8c7-4719-8deb-3b2ed2f7b556 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:50.396821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-254f5326-38ad-4b5d-91aa-b9df0f12a95c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1214 microversion: 2.1 time: 0.088607 Sep 01 14:02:50.398864 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 111/211] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:50 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:50.401715 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1238fa92-f8c7-4719-8deb-3b2ed2f7b556 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:50.402283 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1238fa92-f8c7-4719-8deb-3b2ed2f7b556 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:50.403099 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1238fa92-f8c7-4719-8deb-3b2ed2f7b556 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:50.403669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1238fa92-f8c7-4719-8deb-3b2ed2f7b556 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:50.404192 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1238fa92-f8c7-4719-8deb-3b2ed2f7b556 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:50.520279 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4108cc7c-e816-44c9-b7e4-e936e7d0caf7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:50.520890 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4108cc7c-e816-44c9-b7e4-e936e7d0caf7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:50.527644 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4108cc7c-e816-44c9-b7e4-e936e7d0caf7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:50.528435 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4108cc7c-e816-44c9-b7e4-e936e7d0caf7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:50.528872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4108cc7c-e816-44c9-b7e4-e936e7d0caf7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:50.529675 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4108cc7c-e816-44c9-b7e4-e936e7d0caf7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:50.530173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4108cc7c-e816-44c9-b7e4-e936e7d0caf7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:50.530605 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4108cc7c-e816-44c9-b7e4-e936e7d0caf7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:50.642459 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1238fa92-f8c7-4719-8deb-3b2ed2f7b556 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:50.654303 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1238fa92-f8c7-4719-8deb-3b2ed2f7b556 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.285052 Sep 01 14:02:50.655219 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 101/212] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:50 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:50.731905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7ad65d42-5c66-4752-8ba7-6ae1aa85d0bd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:50.732576 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7ad65d42-5c66-4752-8ba7-6ae1aa85d0bd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:50.740580 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7ad65d42-5c66-4752-8ba7-6ae1aa85d0bd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:50.740765 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7ad65d42-5c66-4752-8ba7-6ae1aa85d0bd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:50.741390 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7ad65d42-5c66-4752-8ba7-6ae1aa85d0bd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:50.742991 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7ad65d42-5c66-4752-8ba7-6ae1aa85d0bd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:50.743907 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7ad65d42-5c66-4752-8ba7-6ae1aa85d0bd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:50.744513 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7ad65d42-5c66-4752-8ba7-6ae1aa85d0bd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:50.776196 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4108cc7c-e816-44c9-b7e4-e936e7d0caf7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:50.800818 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4108cc7c-e816-44c9-b7e4-e936e7d0caf7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.283662 Sep 01 14:02:50.802903 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 112/213] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:50 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:50.914124 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7ad65d42-5c66-4752-8ba7-6ae1aa85d0bd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:50.922746 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7ad65d42-5c66-4752-8ba7-6ae1aa85d0bd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:50.924205 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7ad65d42-5c66-4752-8ba7-6ae1aa85d0bd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:50.925386 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7ad65d42-5c66-4752-8ba7-6ae1aa85d0bd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.202344 Sep 01 14:02:50.925980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 102/214] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:50 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:51.435569 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ab9fc848-a54e-4e04-93cc-9c6d675f57a3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:51.436461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ab9fc848-a54e-4e04-93cc-9c6d675f57a3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:51.444594 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab9fc848-a54e-4e04-93cc-9c6d675f57a3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:51.445254 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab9fc848-a54e-4e04-93cc-9c6d675f57a3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:51.445840 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab9fc848-a54e-4e04-93cc-9c6d675f57a3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:51.447158 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab9fc848-a54e-4e04-93cc-9c6d675f57a3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:51.447883 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab9fc848-a54e-4e04-93cc-9c6d675f57a3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:51.449144 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab9fc848-a54e-4e04-93cc-9c6d675f57a3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:51.525984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ab9fc848-a54e-4e04-93cc-9c6d675f57a3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:51.539629 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ab9fc848-a54e-4e04-93cc-9c6d675f57a3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1218 microversion: 2.1 time: 0.111309 Sep 01 14:02:51.540845 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 113/215] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:51 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:51.681807 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-32aaf029-f487-487d-b945-ee8e749fe3ea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:51.683292 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-32aaf029-f487-487d-b945-ee8e749fe3ea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:51.687346 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=63 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:51.691587 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32aaf029-f487-487d-b945-ee8e749fe3ea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:51.693393 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32aaf029-f487-487d-b945-ee8e749fe3ea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:51.694925 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32aaf029-f487-487d-b945-ee8e749fe3ea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:51.695920 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32aaf029-f487-487d-b945-ee8e749fe3ea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:51.696908 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32aaf029-f487-487d-b945-ee8e749fe3ea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:51.699531 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32aaf029-f487-487d-b945-ee8e749fe3ea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:51.828043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cb2b007b-a8da-416e-a125-f5b344d78eec tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:51.828657 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-cb2b007b-a8da-416e-a125-f5b344d78eec tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:51.840204 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cb2b007b-a8da-416e-a125-f5b344d78eec tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:51.840727 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cb2b007b-a8da-416e-a125-f5b344d78eec tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:51.841172 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cb2b007b-a8da-416e-a125-f5b344d78eec tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:51.841926 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cb2b007b-a8da-416e-a125-f5b344d78eec tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:51.842391 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cb2b007b-a8da-416e-a125-f5b344d78eec tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:51.847673 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cb2b007b-a8da-416e-a125-f5b344d78eec tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:52.346049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-32aaf029-f487-487d-b945-ee8e749fe3ea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:52.363778 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-32aaf029-f487-487d-b945-ee8e749fe3ea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.676865 Sep 01 14:02:52.363778 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 103/216] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:51 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:52.363778 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7995d43f-f0d9-438c-9d15-d4bdfb9d5053 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:52.363778 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7995d43f-f0d9-438c-9d15-d4bdfb9d5053 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:52.369003 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cb2b007b-a8da-416e-a125-f5b344d78eec tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:52.371596 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7995d43f-f0d9-438c-9d15-d4bdfb9d5053 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:52.372330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7995d43f-f0d9-438c-9d15-d4bdfb9d5053 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:52.372978 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7995d43f-f0d9-438c-9d15-d4bdfb9d5053 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:52.374207 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7995d43f-f0d9-438c-9d15-d4bdfb9d5053 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:52.374893 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7995d43f-f0d9-438c-9d15-d4bdfb9d5053 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:52.375529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7995d43f-f0d9-438c-9d15-d4bdfb9d5053 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:52.381370 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cb2b007b-a8da-416e-a125-f5b344d78eec tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.558244 Sep 01 14:02:52.401142 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 114/217] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:51 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:52.565200 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ef3382e6-12c4-4f02-88a0-808c4ebe9b86 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:52.566597 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ef3382e6-12c4-4f02-88a0-808c4ebe9b86 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:52.579697 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ef3382e6-12c4-4f02-88a0-808c4ebe9b86 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:52.580446 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ef3382e6-12c4-4f02-88a0-808c4ebe9b86 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:52.581391 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ef3382e6-12c4-4f02-88a0-808c4ebe9b86 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:52.599209 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ef3382e6-12c4-4f02-88a0-808c4ebe9b86 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:52.599209 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ef3382e6-12c4-4f02-88a0-808c4ebe9b86 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:52.599209 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ef3382e6-12c4-4f02-88a0-808c4ebe9b86 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:52.722708 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ef3382e6-12c4-4f02-88a0-808c4ebe9b86 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:52.735208 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ef3382e6-12c4-4f02-88a0-808c4ebe9b86 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1266 microversion: 2.1 time: 0.178049 Sep 01 14:02:52.737594 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 115/218] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:52 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:52.748100 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1bf2401b-9b7d-417f-9945-c31cd31daa35 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Action: 'create', calling method: .version_select at 0x7f1afe011af0>, body: {"keypair": {"name": "tempest-keypair-1686692386", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHa4AlB8gzq3XdpvkA6ujrkERNXx1ic1d7/RGZpaaJcpxreqJ6YPajEHkh4Z0v7Me5uHF82Z1jAhSrOJA37zBf0h9OZj4Uo9degvLVYYc4oiXDTrw21cqxxNWTX8fOOlYQ=="}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:52.752982 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7995d43f-f0d9-438c-9d15-d4bdfb9d5053 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:52.757499 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:52.765158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7995d43f-f0d9-438c-9d15-d4bdfb9d5053 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:52.770412 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7995d43f-f0d9-438c-9d15-d4bdfb9d5053 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:52.774612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7995d43f-f0d9-438c-9d15-d4bdfb9d5053 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.417534 Sep 01 14:02:52.775952 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 104/219] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:52 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:52.776933 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-1bf2401b-9b7d-417f-9945-c31cd31daa35 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for project c19855b809cc43b2925dc3001284baaa. Resources: {'key_pairs'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:02:52.781927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-1bf2401b-9b7d-417f-9945-c31cd31daa35 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for user c0afa15991f14e0ca0d3701d06a89049 and project c19855b809cc43b2925dc3001284baaa. Resources: {'key_pairs'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:02:52.911512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1bf2401b-9b7d-417f-9945-c31cd31daa35 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.172604 Sep 01 14:02:52.912201 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 116/220] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 1 14:02:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:53.384319 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-63842997-f465-4d8e-abdc-5fb8c72c51ca tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:53.385218 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-63842997-f465-4d8e-abdc-5fb8c72c51ca tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:53.393128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-63842997-f465-4d8e-abdc-5fb8c72c51ca tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:53.393833 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-63842997-f465-4d8e-abdc-5fb8c72c51ca tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:53.394509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-63842997-f465-4d8e-abdc-5fb8c72c51ca tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:53.395797 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-63842997-f465-4d8e-abdc-5fb8c72c51ca tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:53.396435 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-63842997-f465-4d8e-abdc-5fb8c72c51ca tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:53.397262 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-63842997-f465-4d8e-abdc-5fb8c72c51ca tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:53.409783 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c9213179-bb64-48e2-940d-5fb99de02fcb tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:53.413396 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c9213179-bb64-48e2-940d-5fb99de02fcb tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:53.429305 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c9213179-bb64-48e2-940d-5fb99de02fcb tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:53.429719 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c9213179-bb64-48e2-940d-5fb99de02fcb tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:53.433815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c9213179-bb64-48e2-940d-5fb99de02fcb tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:53.434587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c9213179-bb64-48e2-940d-5fb99de02fcb tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:53.437014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c9213179-bb64-48e2-940d-5fb99de02fcb tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:53.437472 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c9213179-bb64-48e2-940d-5fb99de02fcb tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:54.034088 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c9213179-bb64-48e2-940d-5fb99de02fcb tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:54.039555 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-63842997-f465-4d8e-abdc-5fb8c72c51ca tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:54.045173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c9213179-bb64-48e2-940d-5fb99de02fcb tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.642935 Sep 01 14:02:54.047230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-63842997-f465-4d8e-abdc-5fb8c72c51ca tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.667776 Sep 01 14:02:54.061639 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 105/221] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:53 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:54.062429 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 117/222] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:53 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:02:54.062796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5a415495-a439-44af-a85e-becfaefcb183 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:54.064927 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5a415495-a439-44af-a85e-becfaefcb183 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:54.069463 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-55d46f96-55fa-4502-8e20-42226cd9bb93 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:54.070284 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-55d46f96-55fa-4502-8e20-42226cd9bb93 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:54.076527 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a415495-a439-44af-a85e-becfaefcb183 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:54.077514 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55d46f96-55fa-4502-8e20-42226cd9bb93 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:54.082769 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55d46f96-55fa-4502-8e20-42226cd9bb93 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:54.082769 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55d46f96-55fa-4502-8e20-42226cd9bb93 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:54.082769 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55d46f96-55fa-4502-8e20-42226cd9bb93 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:54.083146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a415495-a439-44af-a85e-becfaefcb183 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:54.083274 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55d46f96-55fa-4502-8e20-42226cd9bb93 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:54.083377 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a415495-a439-44af-a85e-becfaefcb183 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:54.083474 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55d46f96-55fa-4502-8e20-42226cd9bb93 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:54.083559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a415495-a439-44af-a85e-becfaefcb183 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:54.083559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a415495-a439-44af-a85e-becfaefcb183 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:54.086741 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a415495-a439-44af-a85e-becfaefcb183 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:54.254697 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5a415495-a439-44af-a85e-becfaefcb183 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:54.264145 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5a415495-a439-44af-a85e-becfaefcb183 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1272 microversion: 2.1 time: 0.212797 Sep 01 14:02:54.265976 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 106/223] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:54 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1272 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:54.530028 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-55d46f96-55fa-4502-8e20-42226cd9bb93 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:54.540621 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-55d46f96-55fa-4502-8e20-42226cd9bb93 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:54.548853 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-55d46f96-55fa-4502-8e20-42226cd9bb93 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:54.550384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-55d46f96-55fa-4502-8e20-42226cd9bb93 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.486943 Sep 01 14:02:54.571369 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 118/224] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:54 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:55.073237 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a5f9bd33-b87b-4c0c-afec-1339522827a8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:55.075009 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a5f9bd33-b87b-4c0c-afec-1339522827a8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:55.081549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-63a39af1-ddbb-4e4c-bb0e-5028afb81e77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:55.082477 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-63a39af1-ddbb-4e4c-bb0e-5028afb81e77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:55.089440 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a5f9bd33-b87b-4c0c-afec-1339522827a8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:55.090758 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a5f9bd33-b87b-4c0c-afec-1339522827a8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:55.091528 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a5f9bd33-b87b-4c0c-afec-1339522827a8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:55.092723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a5f9bd33-b87b-4c0c-afec-1339522827a8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:55.093372 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a5f9bd33-b87b-4c0c-afec-1339522827a8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:55.094038 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a5f9bd33-b87b-4c0c-afec-1339522827a8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:55.116769 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-63a39af1-ddbb-4e4c-bb0e-5028afb81e77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:55.123292 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-63a39af1-ddbb-4e4c-bb0e-5028afb81e77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:55.129156 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-63a39af1-ddbb-4e4c-bb0e-5028afb81e77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:55.130254 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-63a39af1-ddbb-4e4c-bb0e-5028afb81e77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:55.132535 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-63a39af1-ddbb-4e4c-bb0e-5028afb81e77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:55.133631 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-63a39af1-ddbb-4e4c-bb0e-5028afb81e77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:55.795033 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a5f9bd33-b87b-4c0c-afec-1339522827a8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:55.804271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a5f9bd33-b87b-4c0c-afec-1339522827a8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.737261 Sep 01 14:02:55.805149 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 119/225] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:55 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:55.810600 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-80a7aa07-e803-46f3-9ca3-fb526c65a241 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:55.811763 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-80a7aa07-e803-46f3-9ca3-fb526c65a241 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:55.818356 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-80a7aa07-e803-46f3-9ca3-fb526c65a241 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:55.819500 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-80a7aa07-e803-46f3-9ca3-fb526c65a241 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:55.820461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-80a7aa07-e803-46f3-9ca3-fb526c65a241 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:55.821476 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-80a7aa07-e803-46f3-9ca3-fb526c65a241 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:55.822328 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-80a7aa07-e803-46f3-9ca3-fb526c65a241 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:55.822990 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-80a7aa07-e803-46f3-9ca3-fb526c65a241 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:55.824965 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-63a39af1-ddbb-4e4c-bb0e-5028afb81e77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:55.839986 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-63a39af1-ddbb-4e4c-bb0e-5028afb81e77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.772680 Sep 01 14:02:55.854368 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 107/226] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:55 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:55.855983 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:55.859530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-72d1e24a-ca46-4088-86bb-408c7eb175e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:55.860142 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-72d1e24a-ca46-4088-86bb-408c7eb175e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:55.869003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-72d1e24a-ca46-4088-86bb-408c7eb175e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:55.869752 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-72d1e24a-ca46-4088-86bb-408c7eb175e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:55.870241 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-72d1e24a-ca46-4088-86bb-408c7eb175e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:55.870966 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-72d1e24a-ca46-4088-86bb-408c7eb175e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:55.871679 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-72d1e24a-ca46-4088-86bb-408c7eb175e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:55.872102 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-72d1e24a-ca46-4088-86bb-408c7eb175e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:56.159557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-72d1e24a-ca46-4088-86bb-408c7eb175e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:56.170676 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-72d1e24a-ca46-4088-86bb-408c7eb175e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:56.176436 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-72d1e24a-ca46-4088-86bb-408c7eb175e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:56.178426 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-72d1e24a-ca46-4088-86bb-408c7eb175e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.322555 Sep 01 14:02:56.179803 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 108/227] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:55 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:56.181293 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-80a7aa07-e803-46f3-9ca3-fb526c65a241 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:56.196272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-80a7aa07-e803-46f3-9ca3-fb526c65a241 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1314 microversion: 2.1 time: 0.388742 Sep 01 14:02:56.196272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 120/228] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:55 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:56.566644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-863018451", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ad8c667-b460-46c7-93b9-306c7a679d39"}], "security_groups": [{"name": "tempest-securitygroup--1803437408"}], "key_name": "tempest-keypair-1686692386", "user_data": "}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:56.739453 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.network.neutron [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] validate_networks() for [('9ad8c667-b460-46c7-93b9-306c7a679d39', None, None, None, None, None)] {{(pid=127812) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:02:56.836537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-beb7b253-38ae-491d-aeb6-d4d29d8aada8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:56.837354 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-beb7b253-38ae-491d-aeb6-d4d29d8aada8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:56.850244 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-beb7b253-38ae-491d-aeb6-d4d29d8aada8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:56.851356 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-beb7b253-38ae-491d-aeb6-d4d29d8aada8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:56.852080 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-beb7b253-38ae-491d-aeb6-d4d29d8aada8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:56.853063 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-beb7b253-38ae-491d-aeb6-d4d29d8aada8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:56.853720 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-beb7b253-38ae-491d-aeb6-d4d29d8aada8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:56.854434 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-beb7b253-38ae-491d-aeb6-d4d29d8aada8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:57.236512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-beb7b253-38ae-491d-aeb6-d4d29d8aada8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:57.245738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-beb7b253-38ae-491d-aeb6-d4d29d8aada8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.418324 Sep 01 14:02:57.267824 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 121/229] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:56 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:57.282159 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-05a67981-6b40-4153-a228-094ebaf31f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:57.283078 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-05a67981-6b40-4153-a228-094ebaf31f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:57.290962 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05a67981-6b40-4153-a228-094ebaf31f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:57.291917 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05a67981-6b40-4153-a228-094ebaf31f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:57.292650 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05a67981-6b40-4153-a228-094ebaf31f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:57.293627 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05a67981-6b40-4153-a228-094ebaf31f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:57.294346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05a67981-6b40-4153-a228-094ebaf31f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:57.295363 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05a67981-6b40-4153-a228-094ebaf31f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:57.561645 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-05a67981-6b40-4153-a228-094ebaf31f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:57.575515 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-05a67981-6b40-4153-a228-094ebaf31f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.306287 Sep 01 14:02:57.580096 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 122/230] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:57 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:57.581485 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4a4b41a3-67ea-414a-9280-4d883cdb0ab1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:57.582291 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4a4b41a3-67ea-414a-9280-4d883cdb0ab1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:57.591539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4a4b41a3-67ea-414a-9280-4d883cdb0ab1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:57.592287 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4a4b41a3-67ea-414a-9280-4d883cdb0ab1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:57.592940 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4a4b41a3-67ea-414a-9280-4d883cdb0ab1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:57.593953 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4a4b41a3-67ea-414a-9280-4d883cdb0ab1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:57.594721 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4a4b41a3-67ea-414a-9280-4d883cdb0ab1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:57.595418 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4a4b41a3-67ea-414a-9280-4d883cdb0ab1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:57.904914 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Flavor limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:02:57.906410 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Image limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:02:57.907380 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Flavor pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:02:57.908826 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Image pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:02:57.911256 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:02:57.948574 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:57.950075 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:57.950801 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:57.951819 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:57.952488 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:57.953189 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:57.992942 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for project c19855b809cc43b2925dc3001284baaa. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:02:57.998383 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for user c0afa15991f14e0ca0d3701d06a89049 and project c19855b809cc43b2925dc3001284baaa. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:02:58.014363 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Going to run 1 instances... {{(pid=127812) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:02:58.018450 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:02:58.021625 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4a4b41a3-67ea-414a-9280-4d883cdb0ab1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:58.033074 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4a4b41a3-67ea-414a-9280-4d883cdb0ab1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1314 microversion: 2.1 time: 0.455552 Sep 01 14:02:58.033960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 123/231] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:57 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:58.052604 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0ffa219e-6f08-4886-b867-f924752061d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:58.053499 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0ffa219e-6f08-4886-b867-f924752061d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:58.059980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ffa219e-6f08-4886-b867-f924752061d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:58.060729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ffa219e-6f08-4886-b867-f924752061d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:58.061354 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ffa219e-6f08-4886-b867-f924752061d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:58.062875 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ffa219e-6f08-4886-b867-f924752061d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:58.063520 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ffa219e-6f08-4886-b867-f924752061d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:58.064141 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ffa219e-6f08-4886-b867-f924752061d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:58.204307 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-67756e1d-a5b1-4b2f-ac91-49e7da94859b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.643624 Sep 01 14:02:58.205407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 109/232] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:02:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 1645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:02:58.211478 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-9eefefc2-5231-4b54-8a3d-9a32dc2b453c req-ca084653-e29b-425a-86b0-5a579244c2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77e2e17f-e2b4-464d-8e04-e73c3c407a30", "tag": "0cf34354-f12b-4528-a9ea-f13c64ba181d"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:02:58.226423 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-9eefefc2-5231-4b54-8a3d-9a32dc2b453c req-ca084653-e29b-425a-86b0-5a579244c2da service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:58.227583 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-9eefefc2-5231-4b54-8a3d-9a32dc2b453c req-ca084653-e29b-425a-86b0-5a579244c2da service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:58.228251 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-9eefefc2-5231-4b54-8a3d-9a32dc2b453c req-ca084653-e29b-425a-86b0-5a579244c2da service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:58.247383 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-9eefefc2-5231-4b54-8a3d-9a32dc2b453c req-ca084653-e29b-425a-86b0-5a579244c2da service nova] Creating event network-changed:0cf34354-f12b-4528-a9ea-f13c64ba181d for instance 77e2e17f-e2b4-464d-8e04-e73c3c407a30 on hv-cinder-85221 Sep 01 14:02:58.259077 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-9eefefc2-5231-4b54-8a3d-9a32dc2b453c req-ca084653-e29b-425a-86b0-5a579244c2da service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051631 Sep 01 14:02:58.260407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 110/233] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:02:58.267769 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5863e405-bc18-4485-bd2d-97fce045f631 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:58.271138 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5863e405-bc18-4485-bd2d-97fce045f631 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:58.560595 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5863e405-bc18-4485-bd2d-97fce045f631 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:58.575698 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5863e405-bc18-4485-bd2d-97fce045f631 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1241 microversion: 2.1 time: 0.313796 Sep 01 14:02:58.581994 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 111/234] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:58 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1241 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:58.582142 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0ffa219e-6f08-4886-b867-f924752061d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:58.583796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-50b41fa0-be3c-4f26-8a9b-f0cfe5489463 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:58.586220 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-50b41fa0-be3c-4f26-8a9b-f0cfe5489463 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:58.597244 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0ffa219e-6f08-4886-b867-f924752061d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:58.598751 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0ffa219e-6f08-4886-b867-f924752061d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:58.599996 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0ffa219e-6f08-4886-b867-f924752061d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.552587 Sep 01 14:02:58.603322 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 124/235] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:58 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:02:58.618314 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-50b41fa0-be3c-4f26-8a9b-f0cfe5489463 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:58.618314 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-50b41fa0-be3c-4f26-8a9b-f0cfe5489463 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:58.618314 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-50b41fa0-be3c-4f26-8a9b-f0cfe5489463 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:58.618314 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-50b41fa0-be3c-4f26-8a9b-f0cfe5489463 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:58.618878 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-50b41fa0-be3c-4f26-8a9b-f0cfe5489463 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:58.618878 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-50b41fa0-be3c-4f26-8a9b-f0cfe5489463 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:58.636532 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-20da56a7-63f0-4b5e-8f1e-d51fef62cb71 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:58.638562 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-20da56a7-63f0-4b5e-8f1e-d51fef62cb71 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:58.651403 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-20da56a7-63f0-4b5e-8f1e-d51fef62cb71 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:58.654539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-20da56a7-63f0-4b5e-8f1e-d51fef62cb71 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:58.655229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-20da56a7-63f0-4b5e-8f1e-d51fef62cb71 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:58.658261 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-20da56a7-63f0-4b5e-8f1e-d51fef62cb71 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:58.660364 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-20da56a7-63f0-4b5e-8f1e-d51fef62cb71 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:58.661501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-20da56a7-63f0-4b5e-8f1e-d51fef62cb71 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:58.975373 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:02:59.440470 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-50b41fa0-be3c-4f26-8a9b-f0cfe5489463 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:59.467651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-50b41fa0-be3c-4f26-8a9b-f0cfe5489463 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.889900 Sep 01 14:02:59.469957 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-20da56a7-63f0-4b5e-8f1e-d51fef62cb71 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:59.472671 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 112/236] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:58 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:59.482670 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-20da56a7-63f0-4b5e-8f1e-d51fef62cb71 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.854418 Sep 01 14:02:59.492478 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2943cf1e-8227-47e5-97cc-03873d589175 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:59.493718 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2943cf1e-8227-47e5-97cc-03873d589175 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:59.494468 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 125/237] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:58 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:59.501008 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2943cf1e-8227-47e5-97cc-03873d589175 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:59.501602 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2943cf1e-8227-47e5-97cc-03873d589175 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:59.502070 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2943cf1e-8227-47e5-97cc-03873d589175 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:59.502819 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2943cf1e-8227-47e5-97cc-03873d589175 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:59.504575 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2943cf1e-8227-47e5-97cc-03873d589175 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:59.504575 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2943cf1e-8227-47e5-97cc-03873d589175 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:59.596986 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-11e2828d-881e-4442-80fd-2649a8f31968 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:59.597738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-11e2828d-881e-4442-80fd-2649a8f31968 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:59.608511 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-11e2828d-881e-4442-80fd-2649a8f31968 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:59.609244 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-11e2828d-881e-4442-80fd-2649a8f31968 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:59.609854 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-11e2828d-881e-4442-80fd-2649a8f31968 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:59.610704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-11e2828d-881e-4442-80fd-2649a8f31968 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:59.611333 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-11e2828d-881e-4442-80fd-2649a8f31968 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:59.612113 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-11e2828d-881e-4442-80fd-2649a8f31968 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:59.735154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-11e2828d-881e-4442-80fd-2649a8f31968 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:59.746899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-11e2828d-881e-4442-80fd-2649a8f31968 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1245 microversion: 2.1 time: 0.153360 Sep 01 14:02:59.749757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 126/238] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:59 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1245 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:59.752472 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2943cf1e-8227-47e5-97cc-03873d589175 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:59.755201 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-079e3b4d-0fd5-4e12-ab13-98f1e157b4ef tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:02:59.756288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-079e3b4d-0fd5-4e12-ab13-98f1e157b4ef tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:02:59.765317 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2943cf1e-8227-47e5-97cc-03873d589175 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1314 microversion: 2.1 time: 0.279725 Sep 01 14:02:59.769120 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 113/239] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:02:59 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:02:59.773841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-079e3b4d-0fd5-4e12-ab13-98f1e157b4ef tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:59.775000 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-079e3b4d-0fd5-4e12-ab13-98f1e157b4ef tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:59.775536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-079e3b4d-0fd5-4e12-ab13-98f1e157b4ef tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:59.776454 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-079e3b4d-0fd5-4e12-ab13-98f1e157b4ef tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:02:59.776997 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-079e3b4d-0fd5-4e12-ab13-98f1e157b4ef tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:02:59.777493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-079e3b4d-0fd5-4e12-ab13-98f1e157b4ef tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:02:59.931446 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-079e3b4d-0fd5-4e12-ab13-98f1e157b4ef tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:59.950167 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-079e3b4d-0fd5-4e12-ab13-98f1e157b4ef tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:59.961501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-079e3b4d-0fd5-4e12-ab13-98f1e157b4ef tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:02:59.961501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-079e3b4d-0fd5-4e12-ab13-98f1e157b4ef tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1742 microversion: 2.20 time: 0.204769 Sep 01 14:02:59.961501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 127/240] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:02:59 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1742 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:00.502183 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5c648179-e507-4032-abe6-9593f7f49e68 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:00.503320 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e300079c-308c-4327-bdeb-9aac96eccf41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:00.504052 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e300079c-308c-4327-bdeb-9aac96eccf41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:00.505321 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5c648179-e507-4032-abe6-9593f7f49e68 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:00.517191 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5c648179-e507-4032-abe6-9593f7f49e68 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:00.517191 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5c648179-e507-4032-abe6-9593f7f49e68 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:00.517191 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5c648179-e507-4032-abe6-9593f7f49e68 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:00.517927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e300079c-308c-4327-bdeb-9aac96eccf41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:00.518713 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e300079c-308c-4327-bdeb-9aac96eccf41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:00.519427 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e300079c-308c-4327-bdeb-9aac96eccf41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:00.520290 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e300079c-308c-4327-bdeb-9aac96eccf41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:00.520894 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e300079c-308c-4327-bdeb-9aac96eccf41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:00.521323 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e300079c-308c-4327-bdeb-9aac96eccf41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:00.523306 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5c648179-e507-4032-abe6-9593f7f49e68 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:00.523941 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5c648179-e507-4032-abe6-9593f7f49e68 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:00.524346 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5c648179-e507-4032-abe6-9593f7f49e68 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:00.724637 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e300079c-308c-4327-bdeb-9aac96eccf41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:00.726352 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5c648179-e507-4032-abe6-9593f7f49e68 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:00.735823 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e300079c-308c-4327-bdeb-9aac96eccf41 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.236929 Sep 01 14:03:00.736698 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5c648179-e507-4032-abe6-9593f7f49e68 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.242603 Sep 01 14:03:00.751293 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 114/241] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:00 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:00.753709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 128/242] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:00 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:00.775916 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9fe9b766-689b-4ee8-b480-b9f87c4015ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:00.775916 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9fe9b766-689b-4ee8-b480-b9f87c4015ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:00.781073 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9fe9b766-689b-4ee8-b480-b9f87c4015ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:00.781618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9fe9b766-689b-4ee8-b480-b9f87c4015ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:00.782775 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9fe9b766-689b-4ee8-b480-b9f87c4015ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:00.783513 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9fe9b766-689b-4ee8-b480-b9f87c4015ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:00.783969 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9fe9b766-689b-4ee8-b480-b9f87c4015ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:00.784394 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9fe9b766-689b-4ee8-b480-b9f87c4015ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:00.791964 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d36c2e6d-904a-43da-9adf-3d9e74a472b3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:00.795926 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d36c2e6d-904a-43da-9adf-3d9e74a472b3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:00.810163 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d36c2e6d-904a-43da-9adf-3d9e74a472b3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:00.810666 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d36c2e6d-904a-43da-9adf-3d9e74a472b3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:00.813285 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d36c2e6d-904a-43da-9adf-3d9e74a472b3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:00.814071 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d36c2e6d-904a-43da-9adf-3d9e74a472b3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:00.814536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d36c2e6d-904a-43da-9adf-3d9e74a472b3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:00.815964 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d36c2e6d-904a-43da-9adf-3d9e74a472b3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:00.884904 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9fe9b766-689b-4ee8-b480-b9f87c4015ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:00.897660 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9fe9b766-689b-4ee8-b480-b9f87c4015ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1245 microversion: 2.1 time: 0.128485 Sep 01 14:03:00.898685 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 115/243] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:00 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1245 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:00.979914 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9c941b12-c0b9-49f2-a14d-06499e548f03 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:00.980565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9c941b12-c0b9-49f2-a14d-06499e548f03 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:00.986724 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9c941b12-c0b9-49f2-a14d-06499e548f03 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:00.987505 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9c941b12-c0b9-49f2-a14d-06499e548f03 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:00.988122 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9c941b12-c0b9-49f2-a14d-06499e548f03 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:00.989020 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9c941b12-c0b9-49f2-a14d-06499e548f03 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:00.989691 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9c941b12-c0b9-49f2-a14d-06499e548f03 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:00.990406 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9c941b12-c0b9-49f2-a14d-06499e548f03 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:01.193240 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d36c2e6d-904a-43da-9adf-3d9e74a472b3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:01.210363 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d36c2e6d-904a-43da-9adf-3d9e74a472b3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1314 microversion: 2.1 time: 0.419944 Sep 01 14:03:01.222237 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 129/244] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:00 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:01.287669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9c941b12-c0b9-49f2-a14d-06499e548f03 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:01.296976 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9c941b12-c0b9-49f2-a14d-06499e548f03 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:01.298481 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9c941b12-c0b9-49f2-a14d-06499e548f03 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:01.300010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9c941b12-c0b9-49f2-a14d-06499e548f03 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1742 microversion: 2.20 time: 0.324244 Sep 01 14:03:01.303388 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 116/245] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:00 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1742 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:01.762509 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-133b420a-f391-4af0-9143-253bc1f9667c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:01.763362 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-133b420a-f391-4af0-9143-253bc1f9667c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:01.775251 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4cbd2bae-597a-47b0-ae85-e0f8e525d8b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:01.776035 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4cbd2bae-597a-47b0-ae85-e0f8e525d8b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:01.795491 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4cbd2bae-597a-47b0-ae85-e0f8e525d8b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:01.795982 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4cbd2bae-597a-47b0-ae85-e0f8e525d8b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:01.796414 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4cbd2bae-597a-47b0-ae85-e0f8e525d8b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:01.797120 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4cbd2bae-597a-47b0-ae85-e0f8e525d8b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:01.797571 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4cbd2bae-597a-47b0-ae85-e0f8e525d8b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:01.799015 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-133b420a-f391-4af0-9143-253bc1f9667c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:01.799379 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-133b420a-f391-4af0-9143-253bc1f9667c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:01.799808 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-133b420a-f391-4af0-9143-253bc1f9667c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:01.800681 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-133b420a-f391-4af0-9143-253bc1f9667c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:01.800967 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-133b420a-f391-4af0-9143-253bc1f9667c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:01.801376 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-133b420a-f391-4af0-9143-253bc1f9667c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:01.812757 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4cbd2bae-597a-47b0-ae85-e0f8e525d8b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:02.109484 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-133b420a-f391-4af0-9143-253bc1f9667c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:02.118747 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-133b420a-f391-4af0-9143-253bc1f9667c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.362391 Sep 01 14:03:02.120782 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 130/246] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:01 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:02.147413 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-aa399afe-79f3-4c4c-a1ba-99d5d86e9b80 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:02.148351 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-aa399afe-79f3-4c4c-a1ba-99d5d86e9b80 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:02.174479 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa399afe-79f3-4c4c-a1ba-99d5d86e9b80 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:02.174985 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa399afe-79f3-4c4c-a1ba-99d5d86e9b80 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:02.175629 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa399afe-79f3-4c4c-a1ba-99d5d86e9b80 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:02.176872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa399afe-79f3-4c4c-a1ba-99d5d86e9b80 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:02.180085 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa399afe-79f3-4c4c-a1ba-99d5d86e9b80 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:02.180691 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa399afe-79f3-4c4c-a1ba-99d5d86e9b80 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:02.207521 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4cbd2bae-597a-47b0-ae85-e0f8e525d8b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:02.221820 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4cbd2bae-597a-47b0-ae85-e0f8e525d8b2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.450986 Sep 01 14:03:02.238075 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 117/247] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:01 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:02.249184 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5c7895b5-3a40-48e3-ba8c-fe313905f6b2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:02.250884 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5c7895b5-3a40-48e3-ba8c-fe313905f6b2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:02.267428 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5c7895b5-3a40-48e3-ba8c-fe313905f6b2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:02.268387 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5c7895b5-3a40-48e3-ba8c-fe313905f6b2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:02.268387 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5c7895b5-3a40-48e3-ba8c-fe313905f6b2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:02.270707 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5c7895b5-3a40-48e3-ba8c-fe313905f6b2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:02.271371 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5c7895b5-3a40-48e3-ba8c-fe313905f6b2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:02.271610 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5c7895b5-3a40-48e3-ba8c-fe313905f6b2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:02.336766 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-aa399afe-79f3-4c4c-a1ba-99d5d86e9b80 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:02.346328 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-aa399afe-79f3-4c4c-a1ba-99d5d86e9b80 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1293 microversion: 2.1 time: 0.225922 Sep 01 14:03:02.350088 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 131/248] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:02 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1293 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:02.366553 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-a55e510e-25ea-4d3f-a48b-31d77b250650 req-abf365e7-a33e-49c5-9f33-800aaa5f1272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bac5a33-d73f-48a4-bead-fcf039becf3a", "name": "network-vif-plugged", "status": "completed", "tag": "aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:02.384942 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-a55e510e-25ea-4d3f-a48b-31d77b250650 req-abf365e7-a33e-49c5-9f33-800aaa5f1272 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:02.385928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-a55e510e-25ea-4d3f-a48b-31d77b250650 req-abf365e7-a33e-49c5-9f33-800aaa5f1272 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:02.386560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-a55e510e-25ea-4d3f-a48b-31d77b250650 req-abf365e7-a33e-49c5-9f33-800aaa5f1272 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:02.399971 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-a55e510e-25ea-4d3f-a48b-31d77b250650 req-abf365e7-a33e-49c5-9f33-800aaa5f1272 service nova] Creating event network-vif-plugged:aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025 for instance 0bac5a33-d73f-48a4-bead-fcf039becf3a on hv-cinder-85221 Sep 01 14:03:02.410452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-a55e510e-25ea-4d3f-a48b-31d77b250650 req-abf365e7-a33e-49c5-9f33-800aaa5f1272 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058488 Sep 01 14:03:02.411915 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 132/249] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:02.418257 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9df0be59-2ed2-4608-bdf6-1e63d91dfa9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:02.419172 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9df0be59-2ed2-4608-bdf6-1e63d91dfa9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:02.430686 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9df0be59-2ed2-4608-bdf6-1e63d91dfa9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:02.432797 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9df0be59-2ed2-4608-bdf6-1e63d91dfa9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:02.433290 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9df0be59-2ed2-4608-bdf6-1e63d91dfa9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:02.434000 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9df0be59-2ed2-4608-bdf6-1e63d91dfa9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:02.438272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9df0be59-2ed2-4608-bdf6-1e63d91dfa9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:02.438826 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9df0be59-2ed2-4608-bdf6-1e63d91dfa9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:02.571991 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5c7895b5-3a40-48e3-ba8c-fe313905f6b2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:02.586168 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5c7895b5-3a40-48e3-ba8c-fe313905f6b2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1314 microversion: 2.1 time: 0.346446 Sep 01 14:03:02.587248 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 118/250] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:02 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:02.773794 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9df0be59-2ed2-4608-bdf6-1e63d91dfa9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:02.789741 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9df0be59-2ed2-4608-bdf6-1e63d91dfa9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:02.791604 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9df0be59-2ed2-4608-bdf6-1e63d91dfa9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:02.797550 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9df0be59-2ed2-4608-bdf6-1e63d91dfa9f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.384143 Sep 01 14:03:02.807913 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 133/251] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:02 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:03.140065 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-fb27ca1d-bae4-4c83-842c-a4e309470854 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:03.140687 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fb27ca1d-bae4-4c83-842c-a4e309470854 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:03.157842 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb27ca1d-bae4-4c83-842c-a4e309470854 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:03.159390 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb27ca1d-bae4-4c83-842c-a4e309470854 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:03.160029 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb27ca1d-bae4-4c83-842c-a4e309470854 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:03.163487 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb27ca1d-bae4-4c83-842c-a4e309470854 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:03.167072 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb27ca1d-bae4-4c83-842c-a4e309470854 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:03.171507 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb27ca1d-bae4-4c83-842c-a4e309470854 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:03.247070 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-952c93a6-ff3f-4fc0-b1ea-828aef8cdc78 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:03.247959 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-952c93a6-ff3f-4fc0-b1ea-828aef8cdc78 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:03.250159 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=14 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:03.263111 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952c93a6-ff3f-4fc0-b1ea-828aef8cdc78 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:03.263624 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952c93a6-ff3f-4fc0-b1ea-828aef8cdc78 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:03.264068 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952c93a6-ff3f-4fc0-b1ea-828aef8cdc78 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:03.264782 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952c93a6-ff3f-4fc0-b1ea-828aef8cdc78 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:03.265902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952c93a6-ff3f-4fc0-b1ea-828aef8cdc78 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:03.265902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952c93a6-ff3f-4fc0-b1ea-828aef8cdc78 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:03.720399 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fb27ca1d-bae4-4c83-842c-a4e309470854 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:03.738783 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-fb27ca1d-bae4-4c83-842c-a4e309470854 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.602604 Sep 01 14:03:03.744104 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 119/252] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:03 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:03.766180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4f2193c4-1a0a-48f0-9617-df667452dd02 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:03.768957 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4f2193c4-1a0a-48f0-9617-df667452dd02 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:03.809419 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f2193c4-1a0a-48f0-9617-df667452dd02 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:03.812697 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f2193c4-1a0a-48f0-9617-df667452dd02 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:03.822420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f2193c4-1a0a-48f0-9617-df667452dd02 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:03.823160 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f2193c4-1a0a-48f0-9617-df667452dd02 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:03.824992 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f2193c4-1a0a-48f0-9617-df667452dd02 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:03.827826 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f2193c4-1a0a-48f0-9617-df667452dd02 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:03.967859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-952c93a6-ff3f-4fc0-b1ea-828aef8cdc78 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:03.979645 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-952c93a6-ff3f-4fc0-b1ea-828aef8cdc78 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.737152 Sep 01 14:03:03.986479 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 134/253] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:03 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:04.002560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-41007c27-2ad0-45a9-8d25-cbcd07cfbe2b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:04.003208 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-41007c27-2ad0-45a9-8d25-cbcd07cfbe2b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:04.015956 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41007c27-2ad0-45a9-8d25-cbcd07cfbe2b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:04.016709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41007c27-2ad0-45a9-8d25-cbcd07cfbe2b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:04.017331 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41007c27-2ad0-45a9-8d25-cbcd07cfbe2b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:04.018563 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41007c27-2ad0-45a9-8d25-cbcd07cfbe2b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:04.019171 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41007c27-2ad0-45a9-8d25-cbcd07cfbe2b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:04.019752 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41007c27-2ad0-45a9-8d25-cbcd07cfbe2b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:04.037208 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4f2193c4-1a0a-48f0-9617-df667452dd02 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:04.052361 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4f2193c4-1a0a-48f0-9617-df667452dd02 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1299 microversion: 2.1 time: 0.307073 Sep 01 14:03:04.055297 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 120/254] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:03 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1299 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:04.073036 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-eaf673b6-38a9-4a07-8710-3ffc26796644 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:04.085317 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-eaf673b6-38a9-4a07-8710-3ffc26796644 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:04.104336 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eaf673b6-38a9-4a07-8710-3ffc26796644 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:04.104842 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eaf673b6-38a9-4a07-8710-3ffc26796644 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:04.105331 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eaf673b6-38a9-4a07-8710-3ffc26796644 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:04.108294 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eaf673b6-38a9-4a07-8710-3ffc26796644 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:04.108807 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eaf673b6-38a9-4a07-8710-3ffc26796644 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:04.109262 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eaf673b6-38a9-4a07-8710-3ffc26796644 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:05.060674 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-41007c27-2ad0-45a9-8d25-cbcd07cfbe2b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:05.075555 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-41007c27-2ad0-45a9-8d25-cbcd07cfbe2b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1314 microversion: 2.1 time: 1.080613 Sep 01 14:03:05.089948 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 135/255] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:03 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1314 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:05.111144 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-11e11c5f-b01c-4483-a79e-da82133664d8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:05.114712 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-11e11c5f-b01c-4483-a79e-da82133664d8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:05.138604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-eaf673b6-38a9-4a07-8710-3ffc26796644 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:05.155865 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-11e11c5f-b01c-4483-a79e-da82133664d8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:05.156465 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-eaf673b6-38a9-4a07-8710-3ffc26796644 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:05.157263 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-11e11c5f-b01c-4483-a79e-da82133664d8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:05.160864 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-11e11c5f-b01c-4483-a79e-da82133664d8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:05.162488 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-eaf673b6-38a9-4a07-8710-3ffc26796644 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:05.163898 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-11e11c5f-b01c-4483-a79e-da82133664d8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:05.164701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-11e11c5f-b01c-4483-a79e-da82133664d8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:05.167178 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-11e11c5f-b01c-4483-a79e-da82133664d8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:05.168536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-eaf673b6-38a9-4a07-8710-3ffc26796644 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 1.112003 Sep 01 14:03:05.172126 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 121/256] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:04 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:05.186894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c6cb9429-3fdb-4990-b8ad-6fafdc2dfbe9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:05.187885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c6cb9429-3fdb-4990-b8ad-6fafdc2dfbe9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:05.203968 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6cb9429-3fdb-4990-b8ad-6fafdc2dfbe9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:05.205324 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6cb9429-3fdb-4990-b8ad-6fafdc2dfbe9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:05.206355 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6cb9429-3fdb-4990-b8ad-6fafdc2dfbe9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:05.207305 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6cb9429-3fdb-4990-b8ad-6fafdc2dfbe9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:05.209170 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6cb9429-3fdb-4990-b8ad-6fafdc2dfbe9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:05.212123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6cb9429-3fdb-4990-b8ad-6fafdc2dfbe9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:05.672214 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c6cb9429-3fdb-4990-b8ad-6fafdc2dfbe9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:05.675141 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-11e11c5f-b01c-4483-a79e-da82133664d8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:05.687389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c6cb9429-3fdb-4990-b8ad-6fafdc2dfbe9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.513200 Sep 01 14:03:05.688191 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 122/257] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:05 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:05.697954 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-11e11c5f-b01c-4483-a79e-da82133664d8 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.593498 Sep 01 14:03:05.697954 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 136/258] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:05 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:05.704753 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b3a15c31-c4fa-4f33-90a6-071d87ebed73 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:05.706955 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b3a15c31-c4fa-4f33-90a6-071d87ebed73 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:05.726367 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b3a15c31-c4fa-4f33-90a6-071d87ebed73 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:05.727195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b3a15c31-c4fa-4f33-90a6-071d87ebed73 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:05.727651 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b3a15c31-c4fa-4f33-90a6-071d87ebed73 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:05.728392 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b3a15c31-c4fa-4f33-90a6-071d87ebed73 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:05.728941 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b3a15c31-c4fa-4f33-90a6-071d87ebed73 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:05.729373 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b3a15c31-c4fa-4f33-90a6-071d87ebed73 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:05.877919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-b3a15c31-c4fa-4f33-90a6-071d87ebed73 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:05.882272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:05.892695 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b3a15c31-c4fa-4f33-90a6-071d87ebed73 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1299 microversion: 2.1 time: 0.199943 Sep 01 14:03:05.896343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 137/259] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:05 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1299 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:06.096341 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ea198e5c-6c8e-4977-b259-26e87c83afb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:06.097319 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ea198e5c-6c8e-4977-b259-26e87c83afb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:06.110644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ea198e5c-6c8e-4977-b259-26e87c83afb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:06.117242 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ea198e5c-6c8e-4977-b259-26e87c83afb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:06.117242 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ea198e5c-6c8e-4977-b259-26e87c83afb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:06.117242 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ea198e5c-6c8e-4977-b259-26e87c83afb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:06.117242 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ea198e5c-6c8e-4977-b259-26e87c83afb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:06.125149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ea198e5c-6c8e-4977-b259-26e87c83afb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:06.196999 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a19623c2-7408-455a-be53-a56fe6f07a8e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:06.197760 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a19623c2-7408-455a-be53-a56fe6f07a8e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:06.208443 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a19623c2-7408-455a-be53-a56fe6f07a8e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:06.211062 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a19623c2-7408-455a-be53-a56fe6f07a8e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:06.215821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a19623c2-7408-455a-be53-a56fe6f07a8e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:06.215821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a19623c2-7408-455a-be53-a56fe6f07a8e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:06.215821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a19623c2-7408-455a-be53-a56fe6f07a8e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:06.215821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a19623c2-7408-455a-be53-a56fe6f07a8e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:06.862354 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ea198e5c-6c8e-4977-b259-26e87c83afb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:06.870961 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:06.880014 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ea198e5c-6c8e-4977-b259-26e87c83afb0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1314 microversion: 2.1 time: 0.787166 Sep 01 14:03:06.881091 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 123/260] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:06 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1314 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:06.896245 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-d9f487d5-586c-4be0-a991-5629dfb8f61d req-083f667c-45f3-41e7-bbd5-9eca4da4125f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e2e17f-e2b4-464d-8e04-e73c3c407a30", "name": "network-vif-plugged", "status": "completed", "tag": "0cf34354-f12b-4528-a9ea-f13c64ba181d"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:06.941054 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-d9f487d5-586c-4be0-a991-5629dfb8f61d req-083f667c-45f3-41e7-bbd5-9eca4da4125f service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:06.941054 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-d9f487d5-586c-4be0-a991-5629dfb8f61d req-083f667c-45f3-41e7-bbd5-9eca4da4125f service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:06.941054 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-d9f487d5-586c-4be0-a991-5629dfb8f61d req-083f667c-45f3-41e7-bbd5-9eca4da4125f service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:06.964211 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-d9f487d5-586c-4be0-a991-5629dfb8f61d req-083f667c-45f3-41e7-bbd5-9eca4da4125f service nova] Creating event network-vif-plugged:0cf34354-f12b-4528-a9ea-f13c64ba181d for instance 77e2e17f-e2b4-464d-8e04-e73c3c407a30 on hv-cinder-85221 Sep 01 14:03:06.985030 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-d9f487d5-586c-4be0-a991-5629dfb8f61d req-083f667c-45f3-41e7-bbd5-9eca4da4125f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093658 Sep 01 14:03:06.987535 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 124/261] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:07.005298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c4bab427-c45f-408b-ba4e-220a7a0a7ae2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:07.006303 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c4bab427-c45f-408b-ba4e-220a7a0a7ae2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:07.018304 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a19623c2-7408-455a-be53-a56fe6f07a8e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:07.056516 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c4bab427-c45f-408b-ba4e-220a7a0a7ae2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:07.057392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c4bab427-c45f-408b-ba4e-220a7a0a7ae2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:07.058114 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c4bab427-c45f-408b-ba4e-220a7a0a7ae2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:07.059090 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c4bab427-c45f-408b-ba4e-220a7a0a7ae2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:07.059764 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c4bab427-c45f-408b-ba4e-220a7a0a7ae2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:07.060642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c4bab427-c45f-408b-ba4e-220a7a0a7ae2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:07.063441 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a19623c2-7408-455a-be53-a56fe6f07a8e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:07.076030 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a19623c2-7408-455a-be53-a56fe6f07a8e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:07.077665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a19623c2-7408-455a-be53-a56fe6f07a8e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.885394 Sep 01 14:03:07.078471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 138/262] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:06 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:07.085206 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-48afdc4c-480a-41cb-b4c4-cd58df9eab56 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:07.091866 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-48afdc4c-480a-41cb-b4c4-cd58df9eab56 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:07.114057 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-48afdc4c-480a-41cb-b4c4-cd58df9eab56 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:07.122890 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-48afdc4c-480a-41cb-b4c4-cd58df9eab56 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:07.123805 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-48afdc4c-480a-41cb-b4c4-cd58df9eab56 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:07.125188 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-48afdc4c-480a-41cb-b4c4-cd58df9eab56 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:07.126023 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-48afdc4c-480a-41cb-b4c4-cd58df9eab56 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:07.126742 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-48afdc4c-480a-41cb-b4c4-cd58df9eab56 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:07.558749 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-48afdc4c-480a-41cb-b4c4-cd58df9eab56 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:07.568158 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-48afdc4c-480a-41cb-b4c4-cd58df9eab56 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.488464 Sep 01 14:03:07.579532 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 139/263] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:07 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:07.587029 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-52fa47a5-ad6a-4d7f-8df3-fafef5b52259 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:07.588001 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-52fa47a5-ad6a-4d7f-8df3-fafef5b52259 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:07.604583 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-52fa47a5-ad6a-4d7f-8df3-fafef5b52259 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:07.605599 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-52fa47a5-ad6a-4d7f-8df3-fafef5b52259 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:07.606270 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-52fa47a5-ad6a-4d7f-8df3-fafef5b52259 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:07.607233 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-52fa47a5-ad6a-4d7f-8df3-fafef5b52259 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:07.607896 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-52fa47a5-ad6a-4d7f-8df3-fafef5b52259 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:07.608527 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-52fa47a5-ad6a-4d7f-8df3-fafef5b52259 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:07.662071 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c4bab427-c45f-408b-ba4e-220a7a0a7ae2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:07.719765 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c4bab427-c45f-408b-ba4e-220a7a0a7ae2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1700 microversion: 2.1 time: 0.728763 Sep 01 14:03:07.721007 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 125/264] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:06 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1700 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:07.758843 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-52577b2a-dd70-4094-b549-5280c1a7a5a4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:07.763413 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-52577b2a-dd70-4094-b549-5280c1a7a5a4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:07.765161 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-52577b2a-dd70-4094-b549-5280c1a7a5a4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:07.765725 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-52577b2a-dd70-4094-b549-5280c1a7a5a4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:07.797925 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-52577b2a-dd70-4094-b549-5280c1a7a5a4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Going to try to start instance {{(pid=127812) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 14:03:07.962945 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:08.047983 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-52fa47a5-ad6a-4d7f-8df3-fafef5b52259 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:08.067551 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-52fa47a5-ad6a-4d7f-8df3-fafef5b52259 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1367 microversion: 2.1 time: 0.484510 Sep 01 14:03:08.080061 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 140/265] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:07 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1367 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:08.089188 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7db03220-f325-4017-b759-407ec4c0886e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:08.093853 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7db03220-f325-4017-b759-407ec4c0886e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:08.102942 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7db03220-f325-4017-b759-407ec4c0886e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:08.107471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7db03220-f325-4017-b759-407ec4c0886e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:08.107471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7db03220-f325-4017-b759-407ec4c0886e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:08.107471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7db03220-f325-4017-b759-407ec4c0886e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:08.107471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7db03220-f325-4017-b759-407ec4c0886e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:08.109897 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7db03220-f325-4017-b759-407ec4c0886e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:08.262809 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-52577b2a-dd70-4094-b549-5280c1a7a5a4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "POST /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/action" status: 202 len: 0 microversion: 2.1 time: 0.524508 Sep 01 14:03:08.266889 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 126/266] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:03:07 2022] POST /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:03:08.272759 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b1835c59-eaa1-40b4-b23f-8340771e06d6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:08.273458 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b1835c59-eaa1-40b4-b23f-8340771e06d6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:08.294977 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b1835c59-eaa1-40b4-b23f-8340771e06d6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:08.295496 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b1835c59-eaa1-40b4-b23f-8340771e06d6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:08.295996 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b1835c59-eaa1-40b4-b23f-8340771e06d6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:08.296880 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b1835c59-eaa1-40b4-b23f-8340771e06d6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:08.297167 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b1835c59-eaa1-40b4-b23f-8340771e06d6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:08.297600 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b1835c59-eaa1-40b4-b23f-8340771e06d6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:08.357377 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7db03220-f325-4017-b759-407ec4c0886e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:08.369086 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7db03220-f325-4017-b759-407ec4c0886e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1314 microversion: 2.1 time: 0.287804 Sep 01 14:03:08.369688 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 141/267] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:08 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:08.398569 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5e9d3fa3-4deb-4aa9-8e5f-085d9906bdd4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:08.399525 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-5e9d3fa3-4deb-4aa9-8e5f-085d9906bdd4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:08.412514 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5e9d3fa3-4deb-4aa9-8e5f-085d9906bdd4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:08.416251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5e9d3fa3-4deb-4aa9-8e5f-085d9906bdd4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:08.417940 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5e9d3fa3-4deb-4aa9-8e5f-085d9906bdd4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:08.418993 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5e9d3fa3-4deb-4aa9-8e5f-085d9906bdd4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:08.419646 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5e9d3fa3-4deb-4aa9-8e5f-085d9906bdd4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:08.423499 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5e9d3fa3-4deb-4aa9-8e5f-085d9906bdd4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:08.574866 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=8 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:09.083608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b1835c59-eaa1-40b4-b23f-8340771e06d6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:09.092176 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b1835c59-eaa1-40b4-b23f-8340771e06d6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:09.093644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b1835c59-eaa1-40b4-b23f-8340771e06d6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:09.094881 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b1835c59-eaa1-40b4-b23f-8340771e06d6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.826751 Sep 01 14:03:09.105437 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 127/268] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:08 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:09.115379 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5a0995f0-0bb0-4396-8376-95427fcfe75d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:09.120011 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5a0995f0-0bb0-4396-8376-95427fcfe75d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:09.127999 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a0995f0-0bb0-4396-8376-95427fcfe75d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:09.134762 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a0995f0-0bb0-4396-8376-95427fcfe75d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:09.135478 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a0995f0-0bb0-4396-8376-95427fcfe75d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:09.136466 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a0995f0-0bb0-4396-8376-95427fcfe75d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:09.137224 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a0995f0-0bb0-4396-8376-95427fcfe75d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:09.137927 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a0995f0-0bb0-4396-8376-95427fcfe75d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:09.197797 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5e9d3fa3-4deb-4aa9-8e5f-085d9906bdd4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:09.218704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-5e9d3fa3-4deb-4aa9-8e5f-085d9906bdd4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1709 microversion: 2.1 time: 0.833221 Sep 01 14:03:09.219216 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 142/269] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:08 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1709 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:09.232199 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-80d49345-7144-4d29-966c-62c1ef83512f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:09.234118 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-80d49345-7144-4d29-966c-62c1ef83512f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:09.239416 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:09.254199 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-80d49345-7144-4d29-966c-62c1ef83512f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:09.254965 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-80d49345-7144-4d29-966c-62c1ef83512f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:09.255641 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-80d49345-7144-4d29-966c-62c1ef83512f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:09.271408 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-80d49345-7144-4d29-966c-62c1ef83512f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:09.281211 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-80d49345-7144-4d29-966c-62c1ef83512f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:09.282087 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-80d49345-7144-4d29-966c-62c1ef83512f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:09.672961 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5a0995f0-0bb0-4396-8376-95427fcfe75d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:09.682168 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5a0995f0-0bb0-4396-8376-95427fcfe75d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.575208 Sep 01 14:03:09.682760 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 128/270] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:09 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:09.697505 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c976a4f7-920a-4d3a-bc11-bb0cdb402123 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:09.698359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c976a4f7-920a-4d3a-bc11-bb0cdb402123 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:09.714245 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c976a4f7-920a-4d3a-bc11-bb0cdb402123 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:09.716479 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c976a4f7-920a-4d3a-bc11-bb0cdb402123 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:09.721278 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c976a4f7-920a-4d3a-bc11-bb0cdb402123 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:09.722315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c976a4f7-920a-4d3a-bc11-bb0cdb402123 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:09.722953 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c976a4f7-920a-4d3a-bc11-bb0cdb402123 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:09.723570 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c976a4f7-920a-4d3a-bc11-bb0cdb402123 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:09.752169 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-80d49345-7144-4d29-966c-62c1ef83512f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:09.786599 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-80d49345-7144-4d29-966c-62c1ef83512f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1367 microversion: 2.1 time: 0.556333 Sep 01 14:03:09.788313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 143/271] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:09 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1367 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:09.875700 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-f60666b8-4444-4130-8ee0-8969f9b6badb req-3037574c-0fdd-4abf-833e-e18d93724f03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "237052f9-426e-430e-b59c-ffc2f03c9e11", "tag": "0307fbc0-775a-451f-bec3-f5625a98c36f"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:09.924447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f60666b8-4444-4130-8ee0-8969f9b6badb req-3037574c-0fdd-4abf-833e-e18d93724f03 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:09.925226 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f60666b8-4444-4130-8ee0-8969f9b6badb req-3037574c-0fdd-4abf-833e-e18d93724f03 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:09.925924 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f60666b8-4444-4130-8ee0-8969f9b6badb req-3037574c-0fdd-4abf-833e-e18d93724f03 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:09.963212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-f60666b8-4444-4130-8ee0-8969f9b6badb req-3037574c-0fdd-4abf-833e-e18d93724f03 service nova] Creating event network-changed:0307fbc0-775a-451f-bec3-f5625a98c36f for instance 237052f9-426e-430e-b59c-ffc2f03c9e11 on hv-cinder-85221 Sep 01 14:03:09.980937 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-f60666b8-4444-4130-8ee0-8969f9b6badb req-3037574c-0fdd-4abf-833e-e18d93724f03 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113056 Sep 01 14:03:09.981640 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 144/272] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:10.121296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c7367926-3de2-4978-9129-80c27a8e327c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:10.122267 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c7367926-3de2-4978-9129-80c27a8e327c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:10.133757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c7367926-3de2-4978-9129-80c27a8e327c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:10.134279 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c7367926-3de2-4978-9129-80c27a8e327c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:10.134722 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c7367926-3de2-4978-9129-80c27a8e327c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:10.135468 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c7367926-3de2-4978-9129-80c27a8e327c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:10.135922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c7367926-3de2-4978-9129-80c27a8e327c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:10.136866 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c7367926-3de2-4978-9129-80c27a8e327c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:10.263709 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c976a4f7-920a-4d3a-bc11-bb0cdb402123 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:10.280620 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c976a4f7-920a-4d3a-bc11-bb0cdb402123 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1497 microversion: 2.1 time: 0.593579 Sep 01 14:03:10.290333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 129/273] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:09 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1497 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:10.306355 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8b8e9cf9-d351-4f62-912d-575218173c48 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:10.307043 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8b8e9cf9-d351-4f62-912d-575218173c48 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:10.324565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8b8e9cf9-d351-4f62-912d-575218173c48 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:10.325996 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8b8e9cf9-d351-4f62-912d-575218173c48 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:10.326647 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8b8e9cf9-d351-4f62-912d-575218173c48 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:10.328124 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8b8e9cf9-d351-4f62-912d-575218173c48 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:10.328890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8b8e9cf9-d351-4f62-912d-575218173c48 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:10.329549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8b8e9cf9-d351-4f62-912d-575218173c48 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:10.725522 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c7367926-3de2-4978-9129-80c27a8e327c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:10.760407 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c7367926-3de2-4978-9129-80c27a8e327c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:10.762016 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c7367926-3de2-4978-9129-80c27a8e327c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:10.763256 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c7367926-3de2-4978-9129-80c27a8e327c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.646304 Sep 01 14:03:10.783002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 145/274] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:10 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:10.796156 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b75198be-c99e-443a-a3ba-9bea658fd8e8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:10.796786 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b75198be-c99e-443a-a3ba-9bea658fd8e8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:10.824003 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b75198be-c99e-443a-a3ba-9bea658fd8e8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:10.828842 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b75198be-c99e-443a-a3ba-9bea658fd8e8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:10.831316 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b75198be-c99e-443a-a3ba-9bea658fd8e8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:10.832098 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b75198be-c99e-443a-a3ba-9bea658fd8e8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:10.832580 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b75198be-c99e-443a-a3ba-9bea658fd8e8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:10.833014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b75198be-c99e-443a-a3ba-9bea658fd8e8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:11.128921 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8b8e9cf9-d351-4f62-912d-575218173c48 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:11.135902 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8b8e9cf9-d351-4f62-912d-575218173c48 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1709 microversion: 2.1 time: 0.844274 Sep 01 14:03:11.136498 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 130/275] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:10 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1709 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:11.169619 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9df28507-24ac-4311-8206-252493798865 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:11.170261 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9df28507-24ac-4311-8206-252493798865 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:11.216430 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9df28507-24ac-4311-8206-252493798865 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:11.217256 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9df28507-24ac-4311-8206-252493798865 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:11.217723 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9df28507-24ac-4311-8206-252493798865 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:11.218518 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9df28507-24ac-4311-8206-252493798865 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:11.225652 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9df28507-24ac-4311-8206-252493798865 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:11.229559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9df28507-24ac-4311-8206-252493798865 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:11.699256 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9df28507-24ac-4311-8206-252493798865 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:11.709701 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9df28507-24ac-4311-8206-252493798865 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1367 microversion: 2.1 time: 0.550601 Sep 01 14:03:11.714322 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 131/276] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:11 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1367 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:11.716154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-b75198be-c99e-443a-a3ba-9bea658fd8e8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:11.722032 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-352b35fb-1ea4-467b-b885-d94de561c6cf tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:11.722966 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-352b35fb-1ea4-467b-b885-d94de561c6cf tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:11.727888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b75198be-c99e-443a-a3ba-9bea658fd8e8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.943725 Sep 01 14:03:11.739887 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 146/277] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:10 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:11.747709 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-352b35fb-1ea4-467b-b885-d94de561c6cf tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:11.748550 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-352b35fb-1ea4-467b-b885-d94de561c6cf tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:11.761822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-352b35fb-1ea4-467b-b885-d94de561c6cf tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:11.761822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-352b35fb-1ea4-467b-b885-d94de561c6cf tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:11.761822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-352b35fb-1ea4-467b-b885-d94de561c6cf tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:11.761822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-352b35fb-1ea4-467b-b885-d94de561c6cf tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:11.786740 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-476d9c90-f996-4347-9528-2a81ca14011e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:11.787358 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-476d9c90-f996-4347-9528-2a81ca14011e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:11.790352 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-352b35fb-1ea4-467b-b885-d94de561c6cf tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Going to try to terminate instance {{(pid=127812) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:03:11.801216 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-476d9c90-f996-4347-9528-2a81ca14011e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:11.801719 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-476d9c90-f996-4347-9528-2a81ca14011e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:11.802189 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-476d9c90-f996-4347-9528-2a81ca14011e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:11.802906 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-476d9c90-f996-4347-9528-2a81ca14011e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:11.809701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-476d9c90-f996-4347-9528-2a81ca14011e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:11.813516 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-476d9c90-f996-4347-9528-2a81ca14011e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:12.177391 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-476d9c90-f996-4347-9528-2a81ca14011e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:12.189639 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-476d9c90-f996-4347-9528-2a81ca14011e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:12.191406 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-476d9c90-f996-4347-9528-2a81ca14011e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:12.192838 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-476d9c90-f996-4347-9528-2a81ca14011e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.410244 Sep 01 14:03:12.193981 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 147/278] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:11 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:12.214262 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4f9bbcd1-5fe7-454d-8e83-897f04c5cd4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:12.216769 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4f9bbcd1-5fe7-454d-8e83-897f04c5cd4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:12.222408 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4f9bbcd1-5fe7-454d-8e83-897f04c5cd4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:12.222901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4f9bbcd1-5fe7-454d-8e83-897f04c5cd4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:12.223331 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4f9bbcd1-5fe7-454d-8e83-897f04c5cd4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:12.224263 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4f9bbcd1-5fe7-454d-8e83-897f04c5cd4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:12.224967 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4f9bbcd1-5fe7-454d-8e83-897f04c5cd4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:12.226231 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4f9bbcd1-5fe7-454d-8e83-897f04c5cd4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:12.265220 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-352b35fb-1ea4-467b-b885-d94de561c6cf tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "DELETE /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 204 len: 0 microversion: 2.1 time: 0.549300 Sep 01 14:03:12.265836 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 132/279] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:03:11 2022] DELETE /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:03:12.276255 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-df5b0dd1-d308-4135-b1a0-a76714453bdd tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:12.278067 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-df5b0dd1-d308-4135-b1a0-a76714453bdd tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:12.284823 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df5b0dd1-d308-4135-b1a0-a76714453bdd tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:12.288235 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df5b0dd1-d308-4135-b1a0-a76714453bdd tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:12.289045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df5b0dd1-d308-4135-b1a0-a76714453bdd tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:12.290194 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df5b0dd1-d308-4135-b1a0-a76714453bdd tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:12.290887 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df5b0dd1-d308-4135-b1a0-a76714453bdd tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:12.292042 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df5b0dd1-d308-4135-b1a0-a76714453bdd tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:12.547950 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4f9bbcd1-5fe7-454d-8e83-897f04c5cd4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:12.560497 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4f9bbcd1-5fe7-454d-8e83-897f04c5cd4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1709 microversion: 2.1 time: 0.365036 Sep 01 14:03:12.566025 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 148/280] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:12 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1709 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:12.566142 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-df5b0dd1-d308-4135-b1a0-a76714453bdd tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:12.582023 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-df5b0dd1-d308-4135-b1a0-a76714453bdd tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1503 microversion: 2.1 time: 0.311474 Sep 01 14:03:12.598006 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 133/281] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:12 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1503 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:12.735985 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b9b321e3-9510-49cb-8848-f5246c59aec0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:12.737885 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b9b321e3-9510-49cb-8848-f5246c59aec0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:12.754514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a72293f9-a253-4cff-95b1-669f29233b5b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:12.755243 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a72293f9-a253-4cff-95b1-669f29233b5b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:12.766266 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a72293f9-a253-4cff-95b1-669f29233b5b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:12.766763 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a72293f9-a253-4cff-95b1-669f29233b5b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:12.767203 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a72293f9-a253-4cff-95b1-669f29233b5b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:12.771936 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a72293f9-a253-4cff-95b1-669f29233b5b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:12.771936 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a72293f9-a253-4cff-95b1-669f29233b5b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:12.772151 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b9b321e3-9510-49cb-8848-f5246c59aec0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:12.772151 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b9b321e3-9510-49cb-8848-f5246c59aec0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:12.772808 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b9b321e3-9510-49cb-8848-f5246c59aec0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:12.773792 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b9b321e3-9510-49cb-8848-f5246c59aec0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:12.774774 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b9b321e3-9510-49cb-8848-f5246c59aec0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:12.775492 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b9b321e3-9510-49cb-8848-f5246c59aec0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:12.778282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a72293f9-a253-4cff-95b1-669f29233b5b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:13.612041 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-b9b321e3-9510-49cb-8848-f5246c59aec0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:13.622169 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b9b321e3-9510-49cb-8848-f5246c59aec0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1367 microversion: 2.1 time: 0.891075 Sep 01 14:03:13.643224 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 149/282] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:12 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1367 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:13.654400 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4c3b726e-171a-4be8-a65c-61333ce12a71 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:13.655274 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4c3b726e-171a-4be8-a65c-61333ce12a71 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:13.674465 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4c3b726e-171a-4be8-a65c-61333ce12a71 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:13.675249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4c3b726e-171a-4be8-a65c-61333ce12a71 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:13.678452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4c3b726e-171a-4be8-a65c-61333ce12a71 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:13.679727 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4c3b726e-171a-4be8-a65c-61333ce12a71 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:13.682044 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4c3b726e-171a-4be8-a65c-61333ce12a71 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:13.682701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4c3b726e-171a-4be8-a65c-61333ce12a71 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:13.811921 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a72293f9-a253-4cff-95b1-669f29233b5b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:13.821990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a72293f9-a253-4cff-95b1-669f29233b5b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 1.072184 Sep 01 14:03:13.838599 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 134/283] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:12 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:13.855926 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7dd3b9c9-c683-4e0c-ba4a-f0a0c7059e5b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:13.859370 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7dd3b9c9-c683-4e0c-ba4a-f0a0c7059e5b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:13.868610 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7dd3b9c9-c683-4e0c-ba4a-f0a0c7059e5b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:13.869525 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7dd3b9c9-c683-4e0c-ba4a-f0a0c7059e5b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:13.870232 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7dd3b9c9-c683-4e0c-ba4a-f0a0c7059e5b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:13.871152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7dd3b9c9-c683-4e0c-ba4a-f0a0c7059e5b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:13.872079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7dd3b9c9-c683-4e0c-ba4a-f0a0c7059e5b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:13.872701 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7dd3b9c9-c683-4e0c-ba4a-f0a0c7059e5b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:14.519276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4c3b726e-171a-4be8-a65c-61333ce12a71 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:14.519276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4c3b726e-171a-4be8-a65c-61333ce12a71 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:14.519808 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4c3b726e-171a-4be8-a65c-61333ce12a71 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:14.519808 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4c3b726e-171a-4be8-a65c-61333ce12a71 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.825212 Sep 01 14:03:14.519808 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 150/284] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:13 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:14.520066 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7dd3b9c9-c683-4e0c-ba4a-f0a0c7059e5b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:14.520181 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1f8cdbad-c04a-4f45-ac46-67b469c66264 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:14.520181 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1f8cdbad-c04a-4f45-ac46-67b469c66264 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:14.520181 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f8cdbad-c04a-4f45-ac46-67b469c66264 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:14.520181 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f8cdbad-c04a-4f45-ac46-67b469c66264 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:14.520521 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f8cdbad-c04a-4f45-ac46-67b469c66264 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:14.520521 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f8cdbad-c04a-4f45-ac46-67b469c66264 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:14.520521 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f8cdbad-c04a-4f45-ac46-67b469c66264 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:14.520521 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f8cdbad-c04a-4f45-ac46-67b469c66264 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:14.520825 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7dd3b9c9-c683-4e0c-ba4a-f0a0c7059e5b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1713 microversion: 2.1 time: 0.667520 Sep 01 14:03:14.520825 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 135/285] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:13 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1713 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:14.646201 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-cb76f24d-7707-459e-9b88-69e8cfcbd392 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:14.656148 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-cb76f24d-7707-459e-9b88-69e8cfcbd392 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:14.661855 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cb76f24d-7707-459e-9b88-69e8cfcbd392 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:14.662418 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cb76f24d-7707-459e-9b88-69e8cfcbd392 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:14.663010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cb76f24d-7707-459e-9b88-69e8cfcbd392 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:14.663858 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cb76f24d-7707-459e-9b88-69e8cfcbd392 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:14.664379 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cb76f24d-7707-459e-9b88-69e8cfcbd392 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:14.664865 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cb76f24d-7707-459e-9b88-69e8cfcbd392 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:15.182363 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1f8cdbad-c04a-4f45-ac46-67b469c66264 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:15.192422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1f8cdbad-c04a-4f45-ac46-67b469c66264 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1503 microversion: 2.1 time: 0.719418 Sep 01 14:03:15.194496 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 151/286] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:14 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1503 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:15.223602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a7283f5b-f70c-4f76-80a0-9f92726c4286 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:15.224244 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a7283f5b-f70c-4f76-80a0-9f92726c4286 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:15.239395 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a7283f5b-f70c-4f76-80a0-9f92726c4286 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:15.240348 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a7283f5b-f70c-4f76-80a0-9f92726c4286 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:15.241619 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a7283f5b-f70c-4f76-80a0-9f92726c4286 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:15.242670 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a7283f5b-f70c-4f76-80a0-9f92726c4286 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:15.243349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a7283f5b-f70c-4f76-80a0-9f92726c4286 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:15.243993 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a7283f5b-f70c-4f76-80a0-9f92726c4286 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:15.293275 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-cb76f24d-7707-459e-9b88-69e8cfcbd392 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:15.321920 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-cb76f24d-7707-459e-9b88-69e8cfcbd392 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1367 microversion: 2.1 time: 0.679318 Sep 01 14:03:15.322539 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 136/287] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:14 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1367 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:15.501874 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-fe1502de-2309-4dac-ae72-f2ceb6f3ef5a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:15.503027 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fe1502de-2309-4dac-ae72-f2ceb6f3ef5a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:15.525034 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fe1502de-2309-4dac-ae72-f2ceb6f3ef5a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:15.525034 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fe1502de-2309-4dac-ae72-f2ceb6f3ef5a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:15.525034 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fe1502de-2309-4dac-ae72-f2ceb6f3ef5a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:15.525401 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fe1502de-2309-4dac-ae72-f2ceb6f3ef5a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:15.526375 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fe1502de-2309-4dac-ae72-f2ceb6f3ef5a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:15.527310 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fe1502de-2309-4dac-ae72-f2ceb6f3ef5a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:15.629210 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a7283f5b-f70c-4f76-80a0-9f92726c4286 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:15.652410 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a7283f5b-f70c-4f76-80a0-9f92726c4286 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.441792 Sep 01 14:03:15.653625 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 152/288] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:15 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:15.842765 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fe1502de-2309-4dac-ae72-f2ceb6f3ef5a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:15.862069 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fe1502de-2309-4dac-ae72-f2ceb6f3ef5a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:15.864710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fe1502de-2309-4dac-ae72-f2ceb6f3ef5a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:15.868982 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-fe1502de-2309-4dac-ae72-f2ceb6f3ef5a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.369291 Sep 01 14:03:15.892765 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 137/289] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:15 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:16.176652 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-11aaf269-fce5-439e-be81-ca732b7446ee req-e326da20-39a4-497f-8b61-80fcb5117a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77e2e17f-e2b4-464d-8e04-e73c3c407a30", "name": "network-vif-deleted", "tag": "0cf34354-f12b-4528-a9ea-f13c64ba181d"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:16.187857 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-11aaf269-fce5-439e-be81-ca732b7446ee req-e326da20-39a4-497f-8b61-80fcb5117a06 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:16.188676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-11aaf269-fce5-439e-be81-ca732b7446ee req-e326da20-39a4-497f-8b61-80fcb5117a06 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:16.189296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-11aaf269-fce5-439e-be81-ca732b7446ee req-e326da20-39a4-497f-8b61-80fcb5117a06 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:16.214301 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-73677e21-036a-40b3-8656-d94d5bae9b35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:16.214903 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-73677e21-036a-40b3-8656-d94d5bae9b35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:16.227963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-73677e21-036a-40b3-8656-d94d5bae9b35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:16.229065 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-73677e21-036a-40b3-8656-d94d5bae9b35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:16.229687 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-73677e21-036a-40b3-8656-d94d5bae9b35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:16.231293 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-73677e21-036a-40b3-8656-d94d5bae9b35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:16.232064 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-73677e21-036a-40b3-8656-d94d5bae9b35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:16.232756 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-73677e21-036a-40b3-8656-d94d5bae9b35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:16.238087 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-11aaf269-fce5-439e-be81-ca732b7446ee req-e326da20-39a4-497f-8b61-80fcb5117a06 service nova] Creating event network-vif-deleted:0cf34354-f12b-4528-a9ea-f13c64ba181d for instance 77e2e17f-e2b4-464d-8e04-e73c3c407a30 on hv-cinder-85221 Sep 01 14:03:16.251436 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-11aaf269-fce5-439e-be81-ca732b7446ee req-e326da20-39a4-497f-8b61-80fcb5117a06 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078298 Sep 01 14:03:16.255151 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 153/290] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:16.321457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:16.376705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-37facaf0-7640-4d15-9ee3-3de24f74dc43 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:16.378877 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-37facaf0-7640-4d15-9ee3-3de24f74dc43 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:16.404861 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37facaf0-7640-4d15-9ee3-3de24f74dc43 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:16.408365 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37facaf0-7640-4d15-9ee3-3de24f74dc43 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:16.418252 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37facaf0-7640-4d15-9ee3-3de24f74dc43 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:16.421677 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37facaf0-7640-4d15-9ee3-3de24f74dc43 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:16.422940 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37facaf0-7640-4d15-9ee3-3de24f74dc43 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:16.425045 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37facaf0-7640-4d15-9ee3-3de24f74dc43 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:16.466753 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-73677e21-036a-40b3-8656-d94d5bae9b35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:16.480301 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-73677e21-036a-40b3-8656-d94d5bae9b35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1461 microversion: 2.1 time: 0.265484 Sep 01 14:03:16.483160 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 138/291] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:16 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1461 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:16.679629 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-55a8cc3c-9504-4d7f-905f-1a97c5ec1e82 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:16.680306 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-55a8cc3c-9504-4d7f-905f-1a97c5ec1e82 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:16.695197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-55a8cc3c-9504-4d7f-905f-1a97c5ec1e82 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:16.695614 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-55a8cc3c-9504-4d7f-905f-1a97c5ec1e82 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:16.696049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-55a8cc3c-9504-4d7f-905f-1a97c5ec1e82 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:16.712472 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-55a8cc3c-9504-4d7f-905f-1a97c5ec1e82 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:16.714398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-55a8cc3c-9504-4d7f-905f-1a97c5ec1e82 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:16.714398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-55a8cc3c-9504-4d7f-905f-1a97c5ec1e82 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:16.743370 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-37facaf0-7640-4d15-9ee3-3de24f74dc43 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:16.757476 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-37facaf0-7640-4d15-9ee3-3de24f74dc43 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1367 microversion: 2.1 time: 0.412585 Sep 01 14:03:16.778858 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 154/292] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:16 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1367 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:16.918437 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-60b8bbc0-6314-4628-9d5e-0a472bebf005 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:16.919357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-60b8bbc0-6314-4628-9d5e-0a472bebf005 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:16.931371 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-60b8bbc0-6314-4628-9d5e-0a472bebf005 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:16.935551 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-60b8bbc0-6314-4628-9d5e-0a472bebf005 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:16.936590 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-60b8bbc0-6314-4628-9d5e-0a472bebf005 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:16.940096 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-60b8bbc0-6314-4628-9d5e-0a472bebf005 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:16.940923 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-60b8bbc0-6314-4628-9d5e-0a472bebf005 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:16.941861 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-60b8bbc0-6314-4628-9d5e-0a472bebf005 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:17.288808 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-55a8cc3c-9504-4d7f-905f-1a97c5ec1e82 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:17.322594 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-55a8cc3c-9504-4d7f-905f-1a97c5ec1e82 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.647775 Sep 01 14:03:17.331605 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 139/293] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:16 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:17.429080 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-60b8bbc0-6314-4628-9d5e-0a472bebf005 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:17.432228 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:17.449346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-60b8bbc0-6314-4628-9d5e-0a472bebf005 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:17.450853 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-60b8bbc0-6314-4628-9d5e-0a472bebf005 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:17.452131 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-60b8bbc0-6314-4628-9d5e-0a472bebf005 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.540296 Sep 01 14:03:17.452695 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 155/294] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:16 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:17.508193 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:17.510445 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:17.538241 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:17.541865 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:17.542636 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:17.545310 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:17.549122 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:17.553478 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:17.629808 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:17.638033 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:17.638461 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:17.639886 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:17.639886 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lazy-loading 'fault' on Instance uuid 77e2e17f-e2b4-464d-8e04-e73c3c407a30 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:03:17.771087 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:17.783930 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6043647e-61ac-4430-b09d-4c517ed761d7 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 200 len: 1304 microversion: 2.1 time: 0.282952 Sep 01 14:03:17.785312 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-39f19dd3-ab70-4500-bf79-f7b02db5c47e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:17.785799 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-39f19dd3-ab70-4500-bf79-f7b02db5c47e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:17.788255 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 140/295] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:17 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 1304 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:17.797479 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-39f19dd3-ab70-4500-bf79-f7b02db5c47e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:17.798139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-39f19dd3-ab70-4500-bf79-f7b02db5c47e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:17.798607 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-39f19dd3-ab70-4500-bf79-f7b02db5c47e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:17.799412 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-39f19dd3-ab70-4500-bf79-f7b02db5c47e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:17.799880 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-39f19dd3-ab70-4500-bf79-f7b02db5c47e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:17.800308 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-39f19dd3-ab70-4500-bf79-f7b02db5c47e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:18.099513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-39f19dd3-ab70-4500-bf79-f7b02db5c47e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:18.118102 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-39f19dd3-ab70-4500-bf79-f7b02db5c47e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1367 microversion: 2.1 time: 0.329632 Sep 01 14:03:18.118102 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 156/296] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:17 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:18.353901 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d0f12cb6-373c-4597-b140-bc72ef62d3ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:18.354742 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d0f12cb6-373c-4597-b140-bc72ef62d3ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:18.377236 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0f12cb6-373c-4597-b140-bc72ef62d3ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:18.378298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0f12cb6-373c-4597-b140-bc72ef62d3ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:18.379291 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0f12cb6-373c-4597-b140-bc72ef62d3ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:18.380346 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0f12cb6-373c-4597-b140-bc72ef62d3ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:18.381062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0f12cb6-373c-4597-b140-bc72ef62d3ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:18.381886 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0f12cb6-373c-4597-b140-bc72ef62d3ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:18.493716 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cfa8799d-5c3c-4ac1-b3f1-7dff059a4841 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:18.493716 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-cfa8799d-5c3c-4ac1-b3f1-7dff059a4841 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:18.496140 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cfa8799d-5c3c-4ac1-b3f1-7dff059a4841 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:18.497395 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cfa8799d-5c3c-4ac1-b3f1-7dff059a4841 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:18.498043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cfa8799d-5c3c-4ac1-b3f1-7dff059a4841 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:18.499141 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cfa8799d-5c3c-4ac1-b3f1-7dff059a4841 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:18.499806 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cfa8799d-5c3c-4ac1-b3f1-7dff059a4841 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:18.500231 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cfa8799d-5c3c-4ac1-b3f1-7dff059a4841 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:18.706151 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d0f12cb6-373c-4597-b140-bc72ef62d3ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:18.723760 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d0f12cb6-373c-4597-b140-bc72ef62d3ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.374852 Sep 01 14:03:18.727079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 141/297] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:18 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:18.789663 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cfa8799d-5c3c-4ac1-b3f1-7dff059a4841 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:18.801524 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cfa8799d-5c3c-4ac1-b3f1-7dff059a4841 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:18.808997 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7759f4f6-84a7-40c9-8341-61e071d5a362 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:18.810010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7759f4f6-84a7-40c9-8341-61e071d5a362 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 77e2e17f-e2b4-464d-8e04-e73c3c407a30] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:18.816051 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cfa8799d-5c3c-4ac1-b3f1-7dff059a4841 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:18.817491 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cfa8799d-5c3c-4ac1-b3f1-7dff059a4841 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.340120 Sep 01 14:03:18.819738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 157/298] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:18 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:18.821106 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7759f4f6-84a7-40c9-8341-61e071d5a362 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:18.821835 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7759f4f6-84a7-40c9-8341-61e071d5a362 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:18.822328 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7759f4f6-84a7-40c9-8341-61e071d5a362 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:18.822962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7759f4f6-84a7-40c9-8341-61e071d5a362 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:18.823963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7759f4f6-84a7-40c9-8341-61e071d5a362 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:18.824541 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7759f4f6-84a7-40c9-8341-61e071d5a362 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:18.856259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-7759f4f6-84a7-40c9-8341-61e071d5a362 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] HTTP exception thrown: Instance 77e2e17f-e2b4-464d-8e04-e73c3c407a30 could not be found. Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7759f4f6-84a7-40c9-8341-61e071d5a362 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Request method failure captured: Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 HTTP/1.1 Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELuGepC3YL5_TwNTmgnhfJ2txaQ0Y-qI1gH6kERFCsWeZdyo32KJvUPbqw1FU9lLC1e41zQSa1DcKkzGIUEecx17-vU80nVM5WY7pgU2QnD1nFTZj3099A4QYcLPivbIB9I0EQ5-mM0hYL5iehWumdTzKMIGrxZTki7TjAKiUDM1MCE Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 596cdff155be4dc997ce351b7cd6db08 Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-VolumesActionsTest-479162025 Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:03:18.858680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:03:18.860615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/596cdff155be4dc997ce351b7cd6db08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/596cdff155be4dc997ce351b7cd6db08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/596cdff155be4dc997ce351b7cd6db08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_596cdff155be4dc997ce351b7cd6db08"}]}] Sep 01 14:03:18.860615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-VolumesActionsTest-479162025 Sep 01 14:03:18.860615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 596cdff155be4dc997ce351b7cd6db08 Sep 01 14:03:18.860615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-VolumesActionsTest-479162025 Sep 01 14:03:18.860615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-VolumesActionsTest-479162025-project Sep 01 14:03:18.860615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:03:18.860615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:03:18.860615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 9c60f6eaccad440abff863fe99b40382 Sep 01 14:03:18.860615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-VolumesActionsTest-479162025-project Sep 01 14:03:18.860615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:03:18.860615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 77e2e17f-e2b4-464d-8e04-e73c3c407a30 could not be found. Sep 01 14:03:18.860615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '77e2e17f-e2b4-464d-8e04-e73c3c407a30'} Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77e2e17f-e2b4-464d-8e04-e73c3c407a30 could not be found. Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:03:18.861659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77e2e17f-e2b4-464d-8e04-e73c3c407a30 could not be found. Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77e2e17f-e2b4-464d-8e04-e73c3c407a30 could not be found. Sep 01 14:03:18.863420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:03:18.867043 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7759f4f6-84a7-40c9-8341-61e071d5a362 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Returning 404 to user: Instance 77e2e17f-e2b4-464d-8e04-e73c3c407a30 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:03:18.870560 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7759f4f6-84a7-40c9-8341-61e071d5a362 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30" status: 404 len: 111 microversion: 2.1 time: 0.064231 Sep 01 14:03:18.871680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 142/299] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:18 2022] GET /compute/v2.1/servers/77e2e17f-e2b4-464d-8e04-e73c3c407a30 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:03:19.029220 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1300196047", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "networks": [{"uuid": "2084e95d-fd58-4d52-9363-b07e0b5a21ae"}]}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:19.153087 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b5e9e2e6-27fb-47d3-aeb3-464bde62a9aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:19.162268 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b5e9e2e6-27fb-47d3-aeb3-464bde62a9aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:19.175050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5e9e2e6-27fb-47d3-aeb3-464bde62a9aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:19.176366 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5e9e2e6-27fb-47d3-aeb3-464bde62a9aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:19.177627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5e9e2e6-27fb-47d3-aeb3-464bde62a9aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:19.179409 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5e9e2e6-27fb-47d3-aeb3-464bde62a9aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:19.180502 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5e9e2e6-27fb-47d3-aeb3-464bde62a9aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:19.189481 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5e9e2e6-27fb-47d3-aeb3-464bde62a9aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:19.418681 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b5e9e2e6-27fb-47d3-aeb3-464bde62a9aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:19.431834 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b5e9e2e6-27fb-47d3-aeb3-464bde62a9aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1367 microversion: 2.1 time: 0.296391 Sep 01 14:03:19.455126 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 143/300] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:19 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:19.753676 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-32a33bbb-b4ad-494f-953d-5f533f06d390 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:19.758862 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-32a33bbb-b4ad-494f-953d-5f533f06d390 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:19.772343 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32a33bbb-b4ad-494f-953d-5f533f06d390 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:19.774505 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32a33bbb-b4ad-494f-953d-5f533f06d390 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:19.775319 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32a33bbb-b4ad-494f-953d-5f533f06d390 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:19.780975 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32a33bbb-b4ad-494f-953d-5f533f06d390 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:19.782002 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32a33bbb-b4ad-494f-953d-5f533f06d390 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:19.782737 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32a33bbb-b4ad-494f-953d-5f533f06d390 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:20.071577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-32a33bbb-b4ad-494f-953d-5f533f06d390 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:20.080957 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-32a33bbb-b4ad-494f-953d-5f533f06d390 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.333055 Sep 01 14:03:20.095749 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 144/301] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:19 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:20.100799 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5af4e944-67b5-4349-9896-b1ca607f64f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:20.102374 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5af4e944-67b5-4349-9896-b1ca607f64f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:20.127079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5af4e944-67b5-4349-9896-b1ca607f64f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:20.127538 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5af4e944-67b5-4349-9896-b1ca607f64f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:20.127987 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5af4e944-67b5-4349-9896-b1ca607f64f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:20.129035 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5af4e944-67b5-4349-9896-b1ca607f64f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:20.129495 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5af4e944-67b5-4349-9896-b1ca607f64f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:20.129956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5af4e944-67b5-4349-9896-b1ca607f64f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:20.366337 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5af4e944-67b5-4349-9896-b1ca607f64f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:20.377555 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5af4e944-67b5-4349-9896-b1ca607f64f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:20.386080 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5af4e944-67b5-4349-9896-b1ca607f64f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:20.387814 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5af4e944-67b5-4349-9896-b1ca607f64f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.292868 Sep 01 14:03:20.403217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 145/302] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:20 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:20.451755 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-0894bcc4-e425-4f1e-91ab-7a7dd7c0bea4 req-248bc2bb-200d-4ab4-a81d-814329127836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237052f9-426e-430e-b59c-ffc2f03c9e11", "name": "network-vif-plugged", "status": "completed", "tag": "0307fbc0-775a-451f-bec3-f5625a98c36f"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:20.473131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0894bcc4-e425-4f1e-91ab-7a7dd7c0bea4 req-248bc2bb-200d-4ab4-a81d-814329127836 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:20.474252 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0894bcc4-e425-4f1e-91ab-7a7dd7c0bea4 req-248bc2bb-200d-4ab4-a81d-814329127836 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:20.474970 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0894bcc4-e425-4f1e-91ab-7a7dd7c0bea4 req-248bc2bb-200d-4ab4-a81d-814329127836 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:20.499477 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-0894bcc4-e425-4f1e-91ab-7a7dd7c0bea4 req-248bc2bb-200d-4ab4-a81d-814329127836 service nova] Creating event network-vif-plugged:0307fbc0-775a-451f-bec3-f5625a98c36f for instance 237052f9-426e-430e-b59c-ffc2f03c9e11 on hv-cinder-85221 Sep 01 14:03:20.506103 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-0894bcc4-e425-4f1e-91ab-7a7dd7c0bea4 req-248bc2bb-200d-4ab4-a81d-814329127836 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057994 Sep 01 14:03:20.507488 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 146/303] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:03:20.513764 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4dde427c-0c88-4187-8d25-93c7047737ee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:20.514695 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4dde427c-0c88-4187-8d25-93c7047737ee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:20.524389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4dde427c-0c88-4187-8d25-93c7047737ee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:20.530929 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4dde427c-0c88-4187-8d25-93c7047737ee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:20.531567 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4dde427c-0c88-4187-8d25-93c7047737ee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:20.532468 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4dde427c-0c88-4187-8d25-93c7047737ee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:20.533085 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4dde427c-0c88-4187-8d25-93c7047737ee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:20.533631 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4dde427c-0c88-4187-8d25-93c7047737ee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:20.939975 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4dde427c-0c88-4187-8d25-93c7047737ee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:20.962896 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4dde427c-0c88-4187-8d25-93c7047737ee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1367 microversion: 2.1 time: 0.453464 Sep 01 14:03:20.964486 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 147/304] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:20 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:21.106491 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b5b3d0ae-8c47-41f4-9561-d7f2a33042dd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:21.107682 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b5b3d0ae-8c47-41f4-9561-d7f2a33042dd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:21.125422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5b3d0ae-8c47-41f4-9561-d7f2a33042dd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:21.132161 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5b3d0ae-8c47-41f4-9561-d7f2a33042dd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:21.132811 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5b3d0ae-8c47-41f4-9561-d7f2a33042dd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:21.134076 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5b3d0ae-8c47-41f4-9561-d7f2a33042dd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:21.134939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5b3d0ae-8c47-41f4-9561-d7f2a33042dd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:21.135987 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5b3d0ae-8c47-41f4-9561-d7f2a33042dd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:21.358235 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b5b3d0ae-8c47-41f4-9561-d7f2a33042dd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:21.371581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b5b3d0ae-8c47-41f4-9561-d7f2a33042dd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.270864 Sep 01 14:03:21.385933 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 148/305] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:21 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:21.414718 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-49806ced-ddba-4798-85ca-66a4c3d08c7f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:21.415388 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-49806ced-ddba-4798-85ca-66a4c3d08c7f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:21.422291 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-49806ced-ddba-4798-85ca-66a4c3d08c7f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:21.422785 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-49806ced-ddba-4798-85ca-66a4c3d08c7f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:21.423250 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-49806ced-ddba-4798-85ca-66a4c3d08c7f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:21.423957 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-49806ced-ddba-4798-85ca-66a4c3d08c7f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:21.424548 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-49806ced-ddba-4798-85ca-66a4c3d08c7f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:21.424974 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-49806ced-ddba-4798-85ca-66a4c3d08c7f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:21.782252 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-49806ced-ddba-4798-85ca-66a4c3d08c7f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:21.796938 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-49806ced-ddba-4798-85ca-66a4c3d08c7f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:21.799556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-49806ced-ddba-4798-85ca-66a4c3d08c7f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:21.801002 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-49806ced-ddba-4798-85ca-66a4c3d08c7f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.391170 Sep 01 14:03:21.802085 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 149/306] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:21 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:21.994664 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-fdd30bfb-8af5-4ef3-a479-e4d6e70d5365 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:21.995562 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fdd30bfb-8af5-4ef3-a479-e4d6e70d5365 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:22.004237 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fdd30bfb-8af5-4ef3-a479-e4d6e70d5365 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:22.006715 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fdd30bfb-8af5-4ef3-a479-e4d6e70d5365 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:22.011662 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fdd30bfb-8af5-4ef3-a479-e4d6e70d5365 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:22.012578 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fdd30bfb-8af5-4ef3-a479-e4d6e70d5365 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:22.013186 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fdd30bfb-8af5-4ef3-a479-e4d6e70d5365 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:22.013757 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fdd30bfb-8af5-4ef3-a479-e4d6e70d5365 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:22.232329 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fdd30bfb-8af5-4ef3-a479-e4d6e70d5365 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:22.240044 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-fdd30bfb-8af5-4ef3-a479-e4d6e70d5365 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1367 microversion: 2.1 time: 0.251425 Sep 01 14:03:22.240721 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 150/307] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:21 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:22.392656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f94cf280-2df7-4cd6-a582-174a6bcf0980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:22.393473 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f94cf280-2df7-4cd6-a582-174a6bcf0980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:22.400594 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f94cf280-2df7-4cd6-a582-174a6bcf0980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:22.401064 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f94cf280-2df7-4cd6-a582-174a6bcf0980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:22.401508 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f94cf280-2df7-4cd6-a582-174a6bcf0980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:22.402306 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f94cf280-2df7-4cd6-a582-174a6bcf0980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:22.402770 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f94cf280-2df7-4cd6-a582-174a6bcf0980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:22.403216 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f94cf280-2df7-4cd6-a582-174a6bcf0980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:22.553833 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f94cf280-2df7-4cd6-a582-174a6bcf0980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:22.561789 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f94cf280-2df7-4cd6-a582-174a6bcf0980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.172950 Sep 01 14:03:22.562368 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 151/308] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:22 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:22.825438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-30eec63b-cef9-4da0-852c-b483430f51e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:22.826309 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-30eec63b-cef9-4da0-852c-b483430f51e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:22.832247 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-30eec63b-cef9-4da0-852c-b483430f51e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:22.832740 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-30eec63b-cef9-4da0-852c-b483430f51e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:22.833187 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-30eec63b-cef9-4da0-852c-b483430f51e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:22.833920 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-30eec63b-cef9-4da0-852c-b483430f51e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:22.834894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-30eec63b-cef9-4da0-852c-b483430f51e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:22.835323 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-30eec63b-cef9-4da0-852c-b483430f51e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:22.976981 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-30eec63b-cef9-4da0-852c-b483430f51e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:22.986448 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-30eec63b-cef9-4da0-852c-b483430f51e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:22.987982 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-30eec63b-cef9-4da0-852c-b483430f51e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:22.989148 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-30eec63b-cef9-4da0-852c-b483430f51e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.167719 Sep 01 14:03:22.990049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 152/309] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:22 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:23.265106 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0d197638-f8fa-462d-8b3b-0dcba795c9cd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:23.265731 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0d197638-f8fa-462d-8b3b-0dcba795c9cd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:23.272452 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0d197638-f8fa-462d-8b3b-0dcba795c9cd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:23.272942 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0d197638-f8fa-462d-8b3b-0dcba795c9cd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:23.273415 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0d197638-f8fa-462d-8b3b-0dcba795c9cd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:23.274169 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0d197638-f8fa-462d-8b3b-0dcba795c9cd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:23.274625 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0d197638-f8fa-462d-8b3b-0dcba795c9cd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:23.275058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0d197638-f8fa-462d-8b3b-0dcba795c9cd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:23.435718 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0d197638-f8fa-462d-8b3b-0dcba795c9cd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:23.452383 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0d197638-f8fa-462d-8b3b-0dcba795c9cd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1367 microversion: 2.1 time: 0.193208 Sep 01 14:03:23.452965 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 153/310] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:23 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:23.588189 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9cc12520-c726-461a-8117-f23eb7494299 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:23.588933 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9cc12520-c726-461a-8117-f23eb7494299 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:23.605599 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cc12520-c726-461a-8117-f23eb7494299 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:23.606981 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cc12520-c726-461a-8117-f23eb7494299 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:23.607308 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cc12520-c726-461a-8117-f23eb7494299 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:23.608335 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cc12520-c726-461a-8117-f23eb7494299 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:23.609422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cc12520-c726-461a-8117-f23eb7494299 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:23.616444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cc12520-c726-461a-8117-f23eb7494299 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:23.820134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9cc12520-c726-461a-8117-f23eb7494299 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:23.830340 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9cc12520-c726-461a-8117-f23eb7494299 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.249082 Sep 01 14:03:23.842633 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 154/311] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:23 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:23.963728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.network.neutron [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] validate_networks() for [('2084e95d-fd58-4d52-9363-b07e0b5a21ae', None, None, None, None, None)] {{(pid=127811) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:03:24.013447 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-28707f01-5fee-46c6-98c5-c744dca338eb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:24.014260 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-28707f01-5fee-46c6-98c5-c744dca338eb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:24.021494 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28707f01-5fee-46c6-98c5-c744dca338eb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:24.022249 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28707f01-5fee-46c6-98c5-c744dca338eb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:24.023099 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28707f01-5fee-46c6-98c5-c744dca338eb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:24.024180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28707f01-5fee-46c6-98c5-c744dca338eb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:24.025013 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28707f01-5fee-46c6-98c5-c744dca338eb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:24.025709 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28707f01-5fee-46c6-98c5-c744dca338eb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:24.239293 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-28707f01-5fee-46c6-98c5-c744dca338eb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:24.250477 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-28707f01-5fee-46c6-98c5-c744dca338eb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:24.257491 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-28707f01-5fee-46c6-98c5-c744dca338eb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:24.258558 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-28707f01-5fee-46c6-98c5-c744dca338eb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.249477 Sep 01 14:03:24.280859 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 155/312] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:24 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:24.474986 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-270eb99e-1006-428d-8b01-3a60a6c00136 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:24.477230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-270eb99e-1006-428d-8b01-3a60a6c00136 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:24.492680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-270eb99e-1006-428d-8b01-3a60a6c00136 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:24.493196 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-270eb99e-1006-428d-8b01-3a60a6c00136 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:24.493618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-270eb99e-1006-428d-8b01-3a60a6c00136 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:24.494362 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-270eb99e-1006-428d-8b01-3a60a6c00136 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:24.498281 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-270eb99e-1006-428d-8b01-3a60a6c00136 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:24.499652 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-270eb99e-1006-428d-8b01-3a60a6c00136 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:24.533260 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:24.543066 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Flavor limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:03:24.543746 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Image limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:03:24.545032 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Flavor pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:03:24.545615 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Image pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:03:24.546072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:03:24.556711 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:24.557464 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:24.558191 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:24.559099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:24.559886 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:24.560561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:24.581248 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Getting quotas for project 596cdff155be4dc997ce351b7cd6db08. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:03:24.586728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Getting quotas for user 9c60f6eaccad440abff863fe99b40382 and project 596cdff155be4dc997ce351b7cd6db08. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:03:24.601170 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Going to run 1 instances... {{(pid=127811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:03:24.604652 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:03:24.683193 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-270eb99e-1006-428d-8b01-3a60a6c00136 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:24.692120 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-270eb99e-1006-428d-8b01-3a60a6c00136 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1558 microversion: 2.1 time: 0.223264 Sep 01 14:03:24.693012 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 156/313] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:24 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:24.713323 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ff94571b-fa8e-4923-a217-b8e7715d1f79 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:24.713840 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ff94571b-fa8e-4923-a217-b8e7715d1f79 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:24.720342 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ff94571b-fa8e-4923-a217-b8e7715d1f79 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:24.721250 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ff94571b-fa8e-4923-a217-b8e7715d1f79 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:24.721876 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ff94571b-fa8e-4923-a217-b8e7715d1f79 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:24.723052 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ff94571b-fa8e-4923-a217-b8e7715d1f79 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:24.723520 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ff94571b-fa8e-4923-a217-b8e7715d1f79 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:24.723947 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ff94571b-fa8e-4923-a217-b8e7715d1f79 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:24.746684 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0ac1d781-28fb-4ee1-97a0-98c9d13508fa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.727242 Sep 01 14:03:24.747962 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 158/314] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:03:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 5729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:03:24.762621 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-40b39b58-4cfa-491f-9f05-9ef89517f686 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:24.763531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-40b39b58-4cfa-491f-9f05-9ef89517f686 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:24.823160 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-40b39b58-4cfa-491f-9f05-9ef89517f686 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:24.830849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-40b39b58-4cfa-491f-9f05-9ef89517f686 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1214 microversion: 2.1 time: 0.075099 Sep 01 14:03:24.837820 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 159/315] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:24 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:24.854111 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-fd2d0a42-1115-4712-a1d0-0720b2685190 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:24.854889 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-fd2d0a42-1115-4712-a1d0-0720b2685190 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:24.862155 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fd2d0a42-1115-4712-a1d0-0720b2685190 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:24.862915 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fd2d0a42-1115-4712-a1d0-0720b2685190 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:24.863473 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fd2d0a42-1115-4712-a1d0-0720b2685190 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:24.864431 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fd2d0a42-1115-4712-a1d0-0720b2685190 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:24.865068 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fd2d0a42-1115-4712-a1d0-0720b2685190 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:24.866236 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fd2d0a42-1115-4712-a1d0-0720b2685190 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:24.924144 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ff94571b-fa8e-4923-a217-b8e7715d1f79 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.214591 Sep 01 14:03:24.925107 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 157/316] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 1 14:03:24 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11/os-interface => generated 285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:03:25.114731 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fd2d0a42-1115-4712-a1d0-0720b2685190 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:25.139467 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-fd2d0a42-1115-4712-a1d0-0720b2685190 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.287568 Sep 01 14:03:25.140629 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 160/317] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:24 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:25.289307 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c05bd1ee-fb40-4997-b741-2072c176c9df tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:25.289942 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c05bd1ee-fb40-4997-b741-2072c176c9df tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:25.297016 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c05bd1ee-fb40-4997-b741-2072c176c9df tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:25.297511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c05bd1ee-fb40-4997-b741-2072c176c9df tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:25.297973 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c05bd1ee-fb40-4997-b741-2072c176c9df tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:25.300604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c05bd1ee-fb40-4997-b741-2072c176c9df tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:25.301206 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c05bd1ee-fb40-4997-b741-2072c176c9df tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:25.301643 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c05bd1ee-fb40-4997-b741-2072c176c9df tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:25.590251 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c05bd1ee-fb40-4997-b741-2072c176c9df tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:25.608948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c05bd1ee-fb40-4997-b741-2072c176c9df tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:25.611757 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c05bd1ee-fb40-4997-b741-2072c176c9df tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:25.615193 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c05bd1ee-fb40-4997-b741-2072c176c9df tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1737 microversion: 2.20 time: 0.330549 Sep 01 14:03:25.619004 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 158/318] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:25 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1737 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:25.857497 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0628697b-ec33-4034-b31f-c56b32b6e86b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:25.859068 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0628697b-ec33-4034-b31f-c56b32b6e86b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:26.009059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0628697b-ec33-4034-b31f-c56b32b6e86b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:26.024378 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0628697b-ec33-4034-b31f-c56b32b6e86b tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1214 microversion: 2.1 time: 0.173460 Sep 01 14:03:26.025597 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 161/319] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:25 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:26.163423 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-902df2f1-64eb-4faa-aa92-85227bcc1a84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:26.164203 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-902df2f1-64eb-4faa-aa92-85227bcc1a84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:26.170821 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-902df2f1-64eb-4faa-aa92-85227bcc1a84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:26.171590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-902df2f1-64eb-4faa-aa92-85227bcc1a84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:26.172202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-902df2f1-64eb-4faa-aa92-85227bcc1a84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:26.173097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-902df2f1-64eb-4faa-aa92-85227bcc1a84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:26.173709 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-902df2f1-64eb-4faa-aa92-85227bcc1a84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:26.174323 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-902df2f1-64eb-4faa-aa92-85227bcc1a84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:26.416477 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-902df2f1-64eb-4faa-aa92-85227bcc1a84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:26.425377 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-902df2f1-64eb-4faa-aa92-85227bcc1a84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1522 microversion: 2.1 time: 0.266228 Sep 01 14:03:26.427084 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 159/320] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:26 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:26.640908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-06344d63-90ca-4447-ad50-b786736e57b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:26.641600 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-06344d63-90ca-4447-ad50-b786736e57b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:26.659289 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06344d63-90ca-4447-ad50-b786736e57b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:26.659677 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06344d63-90ca-4447-ad50-b786736e57b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:26.660349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06344d63-90ca-4447-ad50-b786736e57b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:26.661290 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06344d63-90ca-4447-ad50-b786736e57b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:26.662029 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06344d63-90ca-4447-ad50-b786736e57b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:26.662741 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06344d63-90ca-4447-ad50-b786736e57b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:26.987049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-06344d63-90ca-4447-ad50-b786736e57b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:27.007962 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-06344d63-90ca-4447-ad50-b786736e57b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:27.010221 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-06344d63-90ca-4447-ad50-b786736e57b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:27.012491 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-06344d63-90ca-4447-ad50-b786736e57b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1719 microversion: 2.20 time: 0.375441 Sep 01 14:03:27.014114 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 162/321] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:26 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1719 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:27.070697 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c7b1ffdc-492a-45be-8dbe-782ee93fae2c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:27.077142 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c7b1ffdc-492a-45be-8dbe-782ee93fae2c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:27.090406 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7b1ffdc-492a-45be-8dbe-782ee93fae2c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:27.091180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7b1ffdc-492a-45be-8dbe-782ee93fae2c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:27.092638 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7b1ffdc-492a-45be-8dbe-782ee93fae2c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:27.093618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7b1ffdc-492a-45be-8dbe-782ee93fae2c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:27.094382 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7b1ffdc-492a-45be-8dbe-782ee93fae2c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:27.097431 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c7b1ffdc-492a-45be-8dbe-782ee93fae2c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:27.097690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-1e3494e9-406e-441f-be30-f30f3d4a32f0 req-a0bdf6e3-4d00-41b2-bd69-8741e8358759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "237052f9-426e-430e-b59c-ffc2f03c9e11", "tag": "0307fbc0-775a-451f-bec3-f5625a98c36f"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:27.110470 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-1e3494e9-406e-441f-be30-f30f3d4a32f0 req-a0bdf6e3-4d00-41b2-bd69-8741e8358759 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:27.111249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-1e3494e9-406e-441f-be30-f30f3d4a32f0 req-a0bdf6e3-4d00-41b2-bd69-8741e8358759 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:27.113492 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-1e3494e9-406e-441f-be30-f30f3d4a32f0 req-a0bdf6e3-4d00-41b2-bd69-8741e8358759 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:27.134177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-1e3494e9-406e-441f-be30-f30f3d4a32f0 req-a0bdf6e3-4d00-41b2-bd69-8741e8358759 service nova] Creating event network-changed:0307fbc0-775a-451f-bec3-f5625a98c36f for instance 237052f9-426e-430e-b59c-ffc2f03c9e11 on hv-cinder-85221 Sep 01 14:03:27.141720 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-1e3494e9-406e-441f-be30-f30f3d4a32f0 req-a0bdf6e3-4d00-41b2-bd69-8741e8358759 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048323 Sep 01 14:03:27.148967 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 163/322] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:03:27.247561 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c7b1ffdc-492a-45be-8dbe-782ee93fae2c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:27.277173 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c7b1ffdc-492a-45be-8dbe-782ee93fae2c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1210 microversion: 2.1 time: 0.218651 Sep 01 14:03:27.280324 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 160/323] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:27 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1210 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:27.465868 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-afec03f4-6a92-4dab-89e2-2d27484fd37c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:27.466536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-afec03f4-6a92-4dab-89e2-2d27484fd37c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:27.475456 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-afec03f4-6a92-4dab-89e2-2d27484fd37c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:27.476605 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-afec03f4-6a92-4dab-89e2-2d27484fd37c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:27.477054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-afec03f4-6a92-4dab-89e2-2d27484fd37c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:27.477818 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-afec03f4-6a92-4dab-89e2-2d27484fd37c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:27.478301 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-afec03f4-6a92-4dab-89e2-2d27484fd37c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:27.478728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-afec03f4-6a92-4dab-89e2-2d27484fd37c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:27.671888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-afec03f4-6a92-4dab-89e2-2d27484fd37c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:27.683993 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-afec03f4-6a92-4dab-89e2-2d27484fd37c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1502 microversion: 2.1 time: 0.222545 Sep 01 14:03:27.684919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 164/324] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:27 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1502 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:27.707582 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5ebcc3b3-28ad-4a36-bf75-50ebbc3948dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:27.708295 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5ebcc3b3-28ad-4a36-bf75-50ebbc3948dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:27.714998 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5ebcc3b3-28ad-4a36-bf75-50ebbc3948dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:27.715589 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5ebcc3b3-28ad-4a36-bf75-50ebbc3948dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:27.716029 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5ebcc3b3-28ad-4a36-bf75-50ebbc3948dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:27.716855 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5ebcc3b3-28ad-4a36-bf75-50ebbc3948dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:27.717477 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5ebcc3b3-28ad-4a36-bf75-50ebbc3948dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:27.717731 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5ebcc3b3-28ad-4a36-bf75-50ebbc3948dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:28.029119 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5ebcc3b3-28ad-4a36-bf75-50ebbc3948dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:28.046254 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c529a7e7-0212-47e0-ad8b-27364bbcc91e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:28.048860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c529a7e7-0212-47e0-ad8b-27364bbcc91e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:28.072703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5ebcc3b3-28ad-4a36-bf75-50ebbc3948dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1515 microversion: 2.1 time: 0.369185 Sep 01 14:03:28.096588 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c529a7e7-0212-47e0-ad8b-27364bbcc91e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:28.109919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 161/325] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:27 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1515 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:28.110220 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c529a7e7-0212-47e0-ad8b-27364bbcc91e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:28.110220 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c529a7e7-0212-47e0-ad8b-27364bbcc91e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:28.110220 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c529a7e7-0212-47e0-ad8b-27364bbcc91e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:28.110220 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c529a7e7-0212-47e0-ad8b-27364bbcc91e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:28.110843 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c529a7e7-0212-47e0-ad8b-27364bbcc91e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:28.312099 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-85388143-c616-4d76-934a-66ea58a6e655 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:28.315536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-85388143-c616-4d76-934a-66ea58a6e655 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:28.347746 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85388143-c616-4d76-934a-66ea58a6e655 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:28.353077 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85388143-c616-4d76-934a-66ea58a6e655 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:28.354433 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85388143-c616-4d76-934a-66ea58a6e655 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:28.357525 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85388143-c616-4d76-934a-66ea58a6e655 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:28.373464 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85388143-c616-4d76-934a-66ea58a6e655 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:28.375382 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85388143-c616-4d76-934a-66ea58a6e655 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:28.572337 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-85388143-c616-4d76-934a-66ea58a6e655 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:28.575556 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c529a7e7-0212-47e0-ad8b-27364bbcc91e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:28.583734 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c529a7e7-0212-47e0-ad8b-27364bbcc91e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:28.587990 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c529a7e7-0212-47e0-ad8b-27364bbcc91e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:28.593201 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c529a7e7-0212-47e0-ad8b-27364bbcc91e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1719 microversion: 2.20 time: 0.556114 Sep 01 14:03:28.602259 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 165/326] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:28 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1719 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:28.618106 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-85388143-c616-4d76-934a-66ea58a6e655 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1266 microversion: 2.1 time: 0.317823 Sep 01 14:03:28.619414 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 162/327] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:28 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:28.719186 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-896602d0-c2fc-4bfa-af1e-e86650f14708 req-fbd9912b-a442-4c45-8a83-e26f2bf0551e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bac5a33-d73f-48a4-bead-fcf039becf3a", "name": "network-vif-unplugged", "status": "completed", "tag": "aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:28.732816 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-896602d0-c2fc-4bfa-af1e-e86650f14708 req-fbd9912b-a442-4c45-8a83-e26f2bf0551e service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:28.733740 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-896602d0-c2fc-4bfa-af1e-e86650f14708 req-fbd9912b-a442-4c45-8a83-e26f2bf0551e service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:28.734373 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-896602d0-c2fc-4bfa-af1e-e86650f14708 req-fbd9912b-a442-4c45-8a83-e26f2bf0551e service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:28.757341 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-896602d0-c2fc-4bfa-af1e-e86650f14708 req-fbd9912b-a442-4c45-8a83-e26f2bf0551e service nova] Creating event network-vif-unplugged:aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025 for instance 0bac5a33-d73f-48a4-bead-fcf039becf3a on hv-cinder-85221 Sep 01 14:03:28.769799 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-896602d0-c2fc-4bfa-af1e-e86650f14708 req-fbd9912b-a442-4c45-8a83-e26f2bf0551e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064431 Sep 01 14:03:28.771434 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 166/328] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:29.637269 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c9f2b0ca-f027-469b-b26d-0bb25481a382 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:29.638140 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c9f2b0ca-f027-469b-b26d-0bb25481a382 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:29.657335 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-643e882a-c811-48cf-ba5d-94c0f093927c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:29.658115 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-643e882a-c811-48cf-ba5d-94c0f093927c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:29.664777 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9f2b0ca-f027-469b-b26d-0bb25481a382 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:29.665471 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9f2b0ca-f027-469b-b26d-0bb25481a382 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:29.666020 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9f2b0ca-f027-469b-b26d-0bb25481a382 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:29.666955 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9f2b0ca-f027-469b-b26d-0bb25481a382 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:29.667544 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9f2b0ca-f027-469b-b26d-0bb25481a382 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:29.667726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-643e882a-c811-48cf-ba5d-94c0f093927c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:29.668173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-643e882a-c811-48cf-ba5d-94c0f093927c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:29.668378 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9f2b0ca-f027-469b-b26d-0bb25481a382 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:29.668610 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-643e882a-c811-48cf-ba5d-94c0f093927c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:29.669328 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-643e882a-c811-48cf-ba5d-94c0f093927c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:29.669823 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-643e882a-c811-48cf-ba5d-94c0f093927c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:29.670255 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-643e882a-c811-48cf-ba5d-94c0f093927c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:29.775493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-643e882a-c811-48cf-ba5d-94c0f093927c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:29.788296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-643e882a-c811-48cf-ba5d-94c0f093927c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1266 microversion: 2.1 time: 0.135914 Sep 01 14:03:29.802043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 167/329] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:29 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:29.811564 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c08683d6-a05f-4040-9620-6265e1185150 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Action: 'create', calling method: .version_select at 0x7f1afe1e9ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-686709729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7sZEYq4IgB93LCU5TODBb2GGV12TFd/u6rSjUpOPMTkhjvDxGQD8f6lZU9PMRn9vTI/0AaJhx1xSpFHjRzT70sHrKFHFy++7L5TimOUA78PlimFiqzfhRQyJMfLN7FlA=="}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:29.830812 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-c08683d6-a05f-4040-9620-6265e1185150 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Getting quotas for project a9e92afcc6744da393978638b5b986a5. Resources: {'key_pairs'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:03:29.836387 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-c08683d6-a05f-4040-9620-6265e1185150 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Getting quotas for user 026b4316e9fb4f78ae1e9c7c3fa6c201 and project a9e92afcc6744da393978638b5b986a5. Resources: {'key_pairs'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:03:29.859182 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c9f2b0ca-f027-469b-b26d-0bb25481a382 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:29.869078 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c9f2b0ca-f027-469b-b26d-0bb25481a382 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:29.870825 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c9f2b0ca-f027-469b-b26d-0bb25481a382 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:29.872392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c9f2b0ca-f027-469b-b26d-0bb25481a382 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1719 microversion: 2.20 time: 0.239422 Sep 01 14:03:29.872960 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 163/330] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:29 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1719 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:29.986275 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c08683d6-a05f-4040-9620-6265e1185150 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.183039 Sep 01 14:03:29.986877 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 168/331] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 1 14:03:29 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:30.124900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-236862545", "imageRef": "f90d696c-dec3-480e-8faf-b305576989d2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-686709729", "networks": [{"uuid": "9e58cbad-991c-473c-ba12-54e2885203d8"}]}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:30.183905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.network.neutron [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] validate_networks() for [('9e58cbad-991c-473c-ba12-54e2885203d8', None, None, None, None, None)] {{(pid=127812) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:03:30.595420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7b54ed08-4441-4f4d-87a0-69414175ca7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:30.598082 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7b54ed08-4441-4f4d-87a0-69414175ca7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:30.608936 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7b54ed08-4441-4f4d-87a0-69414175ca7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:30.609442 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7b54ed08-4441-4f4d-87a0-69414175ca7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:30.609911 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7b54ed08-4441-4f4d-87a0-69414175ca7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:30.610850 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7b54ed08-4441-4f4d-87a0-69414175ca7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:30.611310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7b54ed08-4441-4f4d-87a0-69414175ca7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:30.611749 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7b54ed08-4441-4f4d-87a0-69414175ca7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:30.639491 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-7b54ed08-4441-4f4d-87a0-69414175ca7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'flavor' on Instance uuid b03c776a-6615-43a6-88bd-58efe9736c7f {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:03:30.907179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Flavor limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:03:30.907750 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Image limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:03:30.908471 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Flavor pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:03:30.908896 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Image pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:03:30.909303 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:03:30.919521 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:30.920742 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:30.920742 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:30.921283 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:30.921737 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:30.922183 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:30.940619 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Getting quotas for project a9e92afcc6744da393978638b5b986a5. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:03:30.945759 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Getting quotas for user 026b4316e9fb4f78ae1e9c7c3fa6c201 and project a9e92afcc6744da393978638b5b986a5. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:03:30.958667 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Going to run 1 instances... {{(pid=127812) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:03:30.960960 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f90d696c-dec3-480e-8faf-b305576989d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:03:31.086977 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-76b0dc3d-5624-4d68-9687-27b291f983ec tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.968579 Sep 01 14:03:31.098050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 164/332] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:03:31.107978 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-024f11a5-6a88-4abb-a927-59f539083178 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:31.109471 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-024f11a5-6a88-4abb-a927-59f539083178 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:31.111971 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7b54ed08-4441-4f4d-87a0-69414175ca7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "POST /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f/action" status: 200 len: 32 microversion: 2.1 time: 0.520717 Sep 01 14:03:31.117419 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 169/333] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:03:30 2022] POST /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f/action => generated 32 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 14:03:31.127719 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f2f55678-949b-4d12-ba09-cf0d811c449d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:31.130392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-024f11a5-6a88-4abb-a927-59f539083178 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:31.130745 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f2f55678-949b-4d12-ba09-cf0d811c449d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:31.131601 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-024f11a5-6a88-4abb-a927-59f539083178 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:31.132403 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-024f11a5-6a88-4abb-a927-59f539083178 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:31.133791 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-024f11a5-6a88-4abb-a927-59f539083178 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:31.133791 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-024f11a5-6a88-4abb-a927-59f539083178 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:31.136396 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-024f11a5-6a88-4abb-a927-59f539083178 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:31.149977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f2f55678-949b-4d12-ba09-cf0d811c449d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:31.150789 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f2f55678-949b-4d12-ba09-cf0d811c449d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:31.151451 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f2f55678-949b-4d12-ba09-cf0d811c449d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:31.152358 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f2f55678-949b-4d12-ba09-cf0d811c449d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:31.153063 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f2f55678-949b-4d12-ba09-cf0d811c449d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:31.153720 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f2f55678-949b-4d12-ba09-cf0d811c449d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:31.294372 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-024f11a5-6a88-4abb-a927-59f539083178 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:31.306048 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-024f11a5-6a88-4abb-a927-59f539083178 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1266 microversion: 2.1 time: 0.205963 Sep 01 14:03:31.308987 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 165/334] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:31 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:31.321162 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9238d92a-f9c0-44a2-a534-986ff640bb8d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:31.321162 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9238d92a-f9c0-44a2-a534-986ff640bb8d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:31.464618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9238d92a-f9c0-44a2-a534-986ff640bb8d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:31.473627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9238d92a-f9c0-44a2-a534-986ff640bb8d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1257 microversion: 2.1 time: 0.163057 Sep 01 14:03:31.475495 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 166/335] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:31 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1257 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:31.506531 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a06a9846-92b7-4cac-b62d-a968e7759b3b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:31.507920 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a06a9846-92b7-4cac-b62d-a968e7759b3b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:31.517158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a06a9846-92b7-4cac-b62d-a968e7759b3b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:31.518190 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a06a9846-92b7-4cac-b62d-a968e7759b3b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:31.518953 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a06a9846-92b7-4cac-b62d-a968e7759b3b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:31.520107 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a06a9846-92b7-4cac-b62d-a968e7759b3b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:31.521460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a06a9846-92b7-4cac-b62d-a968e7759b3b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:31.522840 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a06a9846-92b7-4cac-b62d-a968e7759b3b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:31.607605 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f2f55678-949b-4d12-ba09-cf0d811c449d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:31.634367 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f2f55678-949b-4d12-ba09-cf0d811c449d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:31.636448 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f2f55678-949b-4d12-ba09-cf0d811c449d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:31.637680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f2f55678-949b-4d12-ba09-cf0d811c449d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1722 microversion: 2.20 time: 0.518597 Sep 01 14:03:31.638357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 170/336] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:31 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1722 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:31.679255 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8e799adb-c5d0-471d-a6ab-347f437350fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29cab155-6470-43a3-9892-66b944bf432f"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:31.683421 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8e799adb-c5d0-471d-a6ab-347f437350fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:31.694774 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8e799adb-c5d0-471d-a6ab-347f437350fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:31.695742 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8e799adb-c5d0-471d-a6ab-347f437350fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:31.696453 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8e799adb-c5d0-471d-a6ab-347f437350fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:31.697706 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8e799adb-c5d0-471d-a6ab-347f437350fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:31.698259 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8e799adb-c5d0-471d-a6ab-347f437350fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:31.698942 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8e799adb-c5d0-471d-a6ab-347f437350fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:31.811904 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a06a9846-92b7-4cac-b62d-a968e7759b3b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:31.821316 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a06a9846-92b7-4cac-b62d-a968e7759b3b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.344548 Sep 01 14:03:31.821927 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 167/337] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:31 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:32.328936 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-881f8f08-7e9c-4290-ba20-5dfbe6893e78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:32.329489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-881f8f08-7e9c-4290-ba20-5dfbe6893e78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:32.340265 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-881f8f08-7e9c-4290-ba20-5dfbe6893e78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:32.346515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-881f8f08-7e9c-4290-ba20-5dfbe6893e78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:32.346515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-881f8f08-7e9c-4290-ba20-5dfbe6893e78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:32.346515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-881f8f08-7e9c-4290-ba20-5dfbe6893e78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:32.346515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-881f8f08-7e9c-4290-ba20-5dfbe6893e78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:32.346901 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-881f8f08-7e9c-4290-ba20-5dfbe6893e78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:32.452058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-881f8f08-7e9c-4290-ba20-5dfbe6893e78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:32.469360 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-881f8f08-7e9c-4290-ba20-5dfbe6893e78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1272 microversion: 2.1 time: 0.144587 Sep 01 14:03:32.469993 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 168/338] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:32 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1272 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:32.494602 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-63105c89-4bfd-4c49-8aad-cb3f95f0c3e2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:32.495235 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-63105c89-4bfd-4c49-8aad-cb3f95f0c3e2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:32.871211 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-63105c89-4bfd-4c49-8aad-cb3f95f0c3e2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:32.892534 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-63105c89-4bfd-4c49-8aad-cb3f95f0c3e2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1257 microversion: 2.1 time: 0.401502 Sep 01 14:03:32.894655 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 169/339] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:32 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1257 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:32.905615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-16e63bb7-d320-4949-a519-22ca227a73cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:32.909017 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-16e63bb7-d320-4949-a519-22ca227a73cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:32.922925 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-16e63bb7-d320-4949-a519-22ca227a73cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:32.924023 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-16e63bb7-d320-4949-a519-22ca227a73cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:32.924943 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-16e63bb7-d320-4949-a519-22ca227a73cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:32.926476 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-16e63bb7-d320-4949-a519-22ca227a73cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:32.927447 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-16e63bb7-d320-4949-a519-22ca227a73cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:32.928892 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-16e63bb7-d320-4949-a519-22ca227a73cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:33.003741 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8e799adb-c5d0-471d-a6ab-347f437350fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "POST /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.331131 Sep 01 14:03:33.005682 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 171/340] 10.222.0.61 () {62 vars in 1364 bytes} [Thu Sep 1 14:03:31 2022] POST /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-volume_attachments => generated 188 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 14:03:33.207775 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-16e63bb7-d320-4949-a519-22ca227a73cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:33.216956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-16e63bb7-d320-4949-a519-22ca227a73cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.320147 Sep 01 14:03:33.217851 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 170/341] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:32 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:33.237600 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f540276d-4aee-4241-ae8d-6b66a67bb941 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:33.238223 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f540276d-4aee-4241-ae8d-6b66a67bb941 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:33.245054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f540276d-4aee-4241-ae8d-6b66a67bb941 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:33.245553 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f540276d-4aee-4241-ae8d-6b66a67bb941 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:33.246056 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f540276d-4aee-4241-ae8d-6b66a67bb941 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:33.246763 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f540276d-4aee-4241-ae8d-6b66a67bb941 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:33.247531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f540276d-4aee-4241-ae8d-6b66a67bb941 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:33.247958 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f540276d-4aee-4241-ae8d-6b66a67bb941 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:33.293882 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f540276d-4aee-4241-ae8d-6b66a67bb941 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127811) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 14:03:33.435738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:33.491600 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0391a731-7ae3-463f-8914-ab2bae4fd83a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:33.492592 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0391a731-7ae3-463f-8914-ab2bae4fd83a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:33.499376 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0391a731-7ae3-463f-8914-ab2bae4fd83a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:33.499918 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0391a731-7ae3-463f-8914-ab2bae4fd83a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:33.500404 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0391a731-7ae3-463f-8914-ab2bae4fd83a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:33.501546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0391a731-7ae3-463f-8914-ab2bae4fd83a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:33.502174 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0391a731-7ae3-463f-8914-ab2bae4fd83a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:33.502722 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0391a731-7ae3-463f-8914-ab2bae4fd83a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:33.753538 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f540276d-4aee-4241-ae8d-6b66a67bb941 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "POST /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/action" status: 202 len: 0 microversion: 2.20 time: 0.519603 Sep 01 14:03:33.754406 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 172/342] 10.222.0.61 () {62 vars in 1319 bytes} [Thu Sep 1 14:03:33 2022] POST /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:03:33.765402 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-949cc664-bfc6-4c4d-9ac3-dd2a7d3ed214 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:33.766542 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-949cc664-bfc6-4c4d-9ac3-dd2a7d3ed214 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:33.769747 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0391a731-7ae3-463f-8914-ab2bae4fd83a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:33.776219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-949cc664-bfc6-4c4d-9ac3-dd2a7d3ed214 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:33.777147 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-949cc664-bfc6-4c4d-9ac3-dd2a7d3ed214 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:33.782021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-949cc664-bfc6-4c4d-9ac3-dd2a7d3ed214 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:33.782021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-949cc664-bfc6-4c4d-9ac3-dd2a7d3ed214 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:33.782021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-949cc664-bfc6-4c4d-9ac3-dd2a7d3ed214 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:33.782021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-949cc664-bfc6-4c4d-9ac3-dd2a7d3ed214 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:33.806202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0391a731-7ae3-463f-8914-ab2bae4fd83a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.318788 Sep 01 14:03:33.807734 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 171/343] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:33 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:33.928490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-56745c37-3522-43e3-ab64-dfcac2f8a5c2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:33.934483 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-56745c37-3522-43e3-ab64-dfcac2f8a5c2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:33.954157 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-56745c37-3522-43e3-ab64-dfcac2f8a5c2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:33.954157 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-56745c37-3522-43e3-ab64-dfcac2f8a5c2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:33.954157 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-56745c37-3522-43e3-ab64-dfcac2f8a5c2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:33.955089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-56745c37-3522-43e3-ab64-dfcac2f8a5c2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:33.959465 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-56745c37-3522-43e3-ab64-dfcac2f8a5c2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:33.959465 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-56745c37-3522-43e3-ab64-dfcac2f8a5c2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:34.191454 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-56745c37-3522-43e3-ab64-dfcac2f8a5c2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:34.204674 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-949cc664-bfc6-4c4d-9ac3-dd2a7d3ed214 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:34.225327 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-56745c37-3522-43e3-ab64-dfcac2f8a5c2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1309 microversion: 2.1 time: 0.308743 Sep 01 14:03:34.231066 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-949cc664-bfc6-4c4d-9ac3-dd2a7d3ed214 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:34.234670 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 172/344] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:33 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1309 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:34.242642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-949cc664-bfc6-4c4d-9ac3-dd2a7d3ed214 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:34.249737 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-949cc664-bfc6-4c4d-9ac3-dd2a7d3ed214 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1748 microversion: 2.20 time: 0.489122 Sep 01 14:03:34.257021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b347c5cb-e09e-479b-8d08-5d9a4e8fb4a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:34.267502 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b347c5cb-e09e-479b-8d08-5d9a4e8fb4a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:34.272523 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 173/345] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:33 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1748 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:34.309189 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b347c5cb-e09e-479b-8d08-5d9a4e8fb4a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:34.310934 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b347c5cb-e09e-479b-8d08-5d9a4e8fb4a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:34.315630 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b347c5cb-e09e-479b-8d08-5d9a4e8fb4a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:34.323105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b347c5cb-e09e-479b-8d08-5d9a4e8fb4a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:34.323105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b347c5cb-e09e-479b-8d08-5d9a4e8fb4a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:34.323105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b347c5cb-e09e-479b-8d08-5d9a4e8fb4a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:34.514926 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b347c5cb-e09e-479b-8d08-5d9a4e8fb4a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:34.524707 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b347c5cb-e09e-479b-8d08-5d9a4e8fb4a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.288422 Sep 01 14:03:34.525639 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 173/346] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:34 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:34.844198 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a55c51ed-9f19-4fc0-b847-1c95091f5230 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:34.845466 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a55c51ed-9f19-4fc0-b847-1c95091f5230 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:34.847497 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:34.863358 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a55c51ed-9f19-4fc0-b847-1c95091f5230 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:34.863358 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a55c51ed-9f19-4fc0-b847-1c95091f5230 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:34.863358 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a55c51ed-9f19-4fc0-b847-1c95091f5230 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:34.863358 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a55c51ed-9f19-4fc0-b847-1c95091f5230 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:34.863828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a55c51ed-9f19-4fc0-b847-1c95091f5230 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:34.863828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a55c51ed-9f19-4fc0-b847-1c95091f5230 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:35.016910 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a55c51ed-9f19-4fc0-b847-1c95091f5230 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:35.026060 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a55c51ed-9f19-4fc0-b847-1c95091f5230 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.186059 Sep 01 14:03:35.035472 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 174/347] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:34 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:35.127333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-0d03ecba-0e13-4e28-941b-d4c2d9fbd2a1 req-d4b29f51-1e71-4d36-9373-3d075c8ead61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58", "tag": "ae65f105-61e5-40e0-a2ad-e0283df21835"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:35.149488 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0d03ecba-0e13-4e28-941b-d4c2d9fbd2a1 req-d4b29f51-1e71-4d36-9373-3d075c8ead61 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:35.150499 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0d03ecba-0e13-4e28-941b-d4c2d9fbd2a1 req-d4b29f51-1e71-4d36-9373-3d075c8ead61 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:35.151066 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0d03ecba-0e13-4e28-941b-d4c2d9fbd2a1 req-d4b29f51-1e71-4d36-9373-3d075c8ead61 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:35.179348 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-0d03ecba-0e13-4e28-941b-d4c2d9fbd2a1 req-d4b29f51-1e71-4d36-9373-3d075c8ead61 service nova] Creating event network-changed:ae65f105-61e5-40e0-a2ad-e0283df21835 for instance 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 on hv-cinder-85221 Sep 01 14:03:35.192457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-0d03ecba-0e13-4e28-941b-d4c2d9fbd2a1 req-d4b29f51-1e71-4d36-9373-3d075c8ead61 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069278 Sep 01 14:03:35.195125 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 174/348] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:03:35.291378 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-873a9545-47df-47fd-89ea-4bb5549b61cc tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:35.296015 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-873a9545-47df-47fd-89ea-4bb5549b61cc tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:35.303035 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9503073d-1d26-4650-ba40-db849337b195 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:35.310178 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9503073d-1d26-4650-ba40-db849337b195 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:35.327996 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-873a9545-47df-47fd-89ea-4bb5549b61cc tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:35.328807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-873a9545-47df-47fd-89ea-4bb5549b61cc tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:35.329592 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-873a9545-47df-47fd-89ea-4bb5549b61cc tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:35.333799 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-873a9545-47df-47fd-89ea-4bb5549b61cc tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:35.340761 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-873a9545-47df-47fd-89ea-4bb5549b61cc tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:35.341932 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-873a9545-47df-47fd-89ea-4bb5549b61cc tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:35.344231 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9503073d-1d26-4650-ba40-db849337b195 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:35.344854 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9503073d-1d26-4650-ba40-db849337b195 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:35.346675 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9503073d-1d26-4650-ba40-db849337b195 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:35.348205 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9503073d-1d26-4650-ba40-db849337b195 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:35.348795 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9503073d-1d26-4650-ba40-db849337b195 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:35.351001 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9503073d-1d26-4650-ba40-db849337b195 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:35.576246 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-873a9545-47df-47fd-89ea-4bb5549b61cc tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:35.600788 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-873a9545-47df-47fd-89ea-4bb5549b61cc tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1317 microversion: 2.1 time: 0.332873 Sep 01 14:03:35.606267 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 175/349] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:35 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1317 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:35.624893 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-38313096-4b16-404d-b66b-a6cc44677a5c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:35.629065 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-38313096-4b16-404d-b66b-a6cc44677a5c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:35.640436 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:35.650406 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-38313096-4b16-404d-b66b-a6cc44677a5c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:35.651865 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-38313096-4b16-404d-b66b-a6cc44677a5c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:35.653048 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-38313096-4b16-404d-b66b-a6cc44677a5c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:35.655060 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-38313096-4b16-404d-b66b-a6cc44677a5c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:35.656265 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-38313096-4b16-404d-b66b-a6cc44677a5c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:35.657426 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-38313096-4b16-404d-b66b-a6cc44677a5c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:35.711176 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9503073d-1d26-4650-ba40-db849337b195 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:35.733606 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9503073d-1d26-4650-ba40-db849337b195 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:35.740783 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9503073d-1d26-4650-ba40-db849337b195 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:35.748430 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9503073d-1d26-4650-ba40-db849337b195 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1748 microversion: 2.20 time: 0.457357 Sep 01 14:03:35.764455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 175/350] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:35 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1748 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:36.040982 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-38313096-4b16-404d-b66b-a6cc44677a5c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:36.051901 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a6681e78-8bf0-479c-83f3-8c17f8a529b9 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:36.052238 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-38313096-4b16-404d-b66b-a6cc44677a5c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.443853 Sep 01 14:03:36.053482 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a6681e78-8bf0-479c-83f3-8c17f8a529b9 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:36.053674 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 176/351] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:35 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:36.078787 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a6681e78-8bf0-479c-83f3-8c17f8a529b9 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:36.079985 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a6681e78-8bf0-479c-83f3-8c17f8a529b9 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:36.080948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a6681e78-8bf0-479c-83f3-8c17f8a529b9 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:36.082478 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a6681e78-8bf0-479c-83f3-8c17f8a529b9 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:36.083379 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a6681e78-8bf0-479c-83f3-8c17f8a529b9 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:36.084313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a6681e78-8bf0-479c-83f3-8c17f8a529b9 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:36.138619 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:36.545234 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a6681e78-8bf0-479c-83f3-8c17f8a529b9 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:36.560160 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a6681e78-8bf0-479c-83f3-8c17f8a529b9 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.513934 Sep 01 14:03:36.567372 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 176/352] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:36 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:36.650539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e2f0b692-7f59-41fb-b8d5-87ccfd718dac tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:36.655305 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e2f0b692-7f59-41fb-b8d5-87ccfd718dac tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:36.664908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e2f0b692-7f59-41fb-b8d5-87ccfd718dac tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:36.665761 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e2f0b692-7f59-41fb-b8d5-87ccfd718dac tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:36.666350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e2f0b692-7f59-41fb-b8d5-87ccfd718dac tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:36.667181 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e2f0b692-7f59-41fb-b8d5-87ccfd718dac tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:36.667958 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e2f0b692-7f59-41fb-b8d5-87ccfd718dac tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:36.668578 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e2f0b692-7f59-41fb-b8d5-87ccfd718dac tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:36.793383 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c1f1965a-240f-477d-a777-c8fea35eff0a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:36.795921 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c1f1965a-240f-477d-a777-c8fea35eff0a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:36.810881 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c1f1965a-240f-477d-a777-c8fea35eff0a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:36.813316 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c1f1965a-240f-477d-a777-c8fea35eff0a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:36.816696 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c1f1965a-240f-477d-a777-c8fea35eff0a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:36.820556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c1f1965a-240f-477d-a777-c8fea35eff0a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:36.824384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c1f1965a-240f-477d-a777-c8fea35eff0a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:36.831056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c1f1965a-240f-477d-a777-c8fea35eff0a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:36.831198 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e2f0b692-7f59-41fb-b8d5-87ccfd718dac tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:36.875161 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e2f0b692-7f59-41fb-b8d5-87ccfd718dac tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1315 microversion: 2.1 time: 0.232136 Sep 01 14:03:36.882070 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 177/353] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:36 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:37.095133 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e6fbbf47-6eb7-4f12-b7f2-ce3c9a8f35e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:37.098720 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e6fbbf47-6eb7-4f12-b7f2-ce3c9a8f35e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:37.114320 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e6fbbf47-6eb7-4f12-b7f2-ce3c9a8f35e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:37.118645 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e6fbbf47-6eb7-4f12-b7f2-ce3c9a8f35e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:37.118645 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e6fbbf47-6eb7-4f12-b7f2-ce3c9a8f35e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:37.118645 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e6fbbf47-6eb7-4f12-b7f2-ce3c9a8f35e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:37.118645 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e6fbbf47-6eb7-4f12-b7f2-ce3c9a8f35e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:37.129323 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e6fbbf47-6eb7-4f12-b7f2-ce3c9a8f35e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:37.358852 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c1f1965a-240f-477d-a777-c8fea35eff0a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:37.387303 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c1f1965a-240f-477d-a777-c8fea35eff0a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:37.391700 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c1f1965a-240f-477d-a777-c8fea35eff0a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:37.398803 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c1f1965a-240f-477d-a777-c8fea35eff0a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1750 microversion: 2.20 time: 0.611782 Sep 01 14:03:37.399964 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 177/354] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:36 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1750 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:37.512843 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e6fbbf47-6eb7-4f12-b7f2-ce3c9a8f35e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:37.526366 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e6fbbf47-6eb7-4f12-b7f2-ce3c9a8f35e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.439330 Sep 01 14:03:37.541548 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 178/355] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:37 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:37.583039 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2a81be7b-0734-4b39-9739-15f4e9606677 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:37.583825 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2a81be7b-0734-4b39-9739-15f4e9606677 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:37.592574 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2a81be7b-0734-4b39-9739-15f4e9606677 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:37.593107 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2a81be7b-0734-4b39-9739-15f4e9606677 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:37.593620 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2a81be7b-0734-4b39-9739-15f4e9606677 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:37.594404 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2a81be7b-0734-4b39-9739-15f4e9606677 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:37.594842 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2a81be7b-0734-4b39-9739-15f4e9606677 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:37.595269 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2a81be7b-0734-4b39-9739-15f4e9606677 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:37.832912 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2a81be7b-0734-4b39-9739-15f4e9606677 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:37.847057 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2a81be7b-0734-4b39-9739-15f4e9606677 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.267588 Sep 01 14:03:37.848881 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 178/356] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:37 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:37.915092 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f2659427-5dbd-45ba-a78b-ec97a7772ed0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:37.917743 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f2659427-5dbd-45ba-a78b-ec97a7772ed0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:37.938043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f2659427-5dbd-45ba-a78b-ec97a7772ed0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:37.939357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f2659427-5dbd-45ba-a78b-ec97a7772ed0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:37.940536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f2659427-5dbd-45ba-a78b-ec97a7772ed0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:37.942655 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f2659427-5dbd-45ba-a78b-ec97a7772ed0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:37.949212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f2659427-5dbd-45ba-a78b-ec97a7772ed0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:37.955461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f2659427-5dbd-45ba-a78b-ec97a7772ed0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:38.198496 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f2659427-5dbd-45ba-a78b-ec97a7772ed0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:38.207645 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f2659427-5dbd-45ba-a78b-ec97a7772ed0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.298760 Sep 01 14:03:38.208675 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 179/357] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:37 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:38.436433 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-647100e1-0ede-4cf4-a98c-70c9966a9d30 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:38.438829 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-647100e1-0ede-4cf4-a98c-70c9966a9d30 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:38.453210 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-647100e1-0ede-4cf4-a98c-70c9966a9d30 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:38.454034 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-647100e1-0ede-4cf4-a98c-70c9966a9d30 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:38.454802 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-647100e1-0ede-4cf4-a98c-70c9966a9d30 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:38.456121 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-647100e1-0ede-4cf4-a98c-70c9966a9d30 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:38.456822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-647100e1-0ede-4cf4-a98c-70c9966a9d30 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:38.457786 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-647100e1-0ede-4cf4-a98c-70c9966a9d30 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:38.551497 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-32c02387-1646-423b-a929-7a2c60ced9fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:38.551497 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-32c02387-1646-423b-a929-7a2c60ced9fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:38.557269 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-32c02387-1646-423b-a929-7a2c60ced9fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:38.557885 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-32c02387-1646-423b-a929-7a2c60ced9fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:38.558345 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-32c02387-1646-423b-a929-7a2c60ced9fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:38.559042 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-32c02387-1646-423b-a929-7a2c60ced9fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:38.570734 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-32c02387-1646-423b-a929-7a2c60ced9fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:38.570734 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-32c02387-1646-423b-a929-7a2c60ced9fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:38.795282 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-32c02387-1646-423b-a929-7a2c60ced9fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:38.813952 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-32c02387-1646-423b-a929-7a2c60ced9fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.267990 Sep 01 14:03:38.815054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 180/358] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:38 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:38.815241 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-647100e1-0ede-4cf4-a98c-70c9966a9d30 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:38.835064 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-647100e1-0ede-4cf4-a98c-70c9966a9d30 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:38.838371 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-647100e1-0ede-4cf4-a98c-70c9966a9d30 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:38.841060 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-647100e1-0ede-4cf4-a98c-70c9966a9d30 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1750 microversion: 2.20 time: 0.414700 Sep 01 14:03:38.841933 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 179/359] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:38 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1750 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:38.874448 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-aa6863a2-d079-4c70-8346-05268d39d9d1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:38.875057 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-aa6863a2-d079-4c70-8346-05268d39d9d1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:38.881654 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa6863a2-d079-4c70-8346-05268d39d9d1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:38.882208 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa6863a2-d079-4c70-8346-05268d39d9d1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:38.882641 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa6863a2-d079-4c70-8346-05268d39d9d1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:38.883341 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa6863a2-d079-4c70-8346-05268d39d9d1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:38.883792 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa6863a2-d079-4c70-8346-05268d39d9d1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:38.884205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa6863a2-d079-4c70-8346-05268d39d9d1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:39.065968 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-aa6863a2-d079-4c70-8346-05268d39d9d1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:39.076173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-aa6863a2-d079-4c70-8346-05268d39d9d1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.205838 Sep 01 14:03:39.076773 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 181/360] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:38 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:39.232697 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5b50ddf8-f110-4c0d-9c1c-d35008f94cb2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:39.232697 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5b50ddf8-f110-4c0d-9c1c-d35008f94cb2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:39.232697 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:39.238452 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b50ddf8-f110-4c0d-9c1c-d35008f94cb2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:39.239226 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b50ddf8-f110-4c0d-9c1c-d35008f94cb2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:39.239852 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b50ddf8-f110-4c0d-9c1c-d35008f94cb2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:39.241222 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b50ddf8-f110-4c0d-9c1c-d35008f94cb2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:39.241679 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b50ddf8-f110-4c0d-9c1c-d35008f94cb2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:39.242161 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b50ddf8-f110-4c0d-9c1c-d35008f94cb2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:39.418244 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5b50ddf8-f110-4c0d-9c1c-d35008f94cb2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:39.426966 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5b50ddf8-f110-4c0d-9c1c-d35008f94cb2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.201602 Sep 01 14:03:39.430724 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 180/361] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:39 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:39.838014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-41c3685c-1a96-40b9-8e40-19d90ff86267 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:39.838563 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-41c3685c-1a96-40b9-8e40-19d90ff86267 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:39.843887 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=14 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:39.845745 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41c3685c-1a96-40b9-8e40-19d90ff86267 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:39.846271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41c3685c-1a96-40b9-8e40-19d90ff86267 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:39.846773 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41c3685c-1a96-40b9-8e40-19d90ff86267 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:39.847509 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41c3685c-1a96-40b9-8e40-19d90ff86267 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:39.847967 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41c3685c-1a96-40b9-8e40-19d90ff86267 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:39.848393 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41c3685c-1a96-40b9-8e40-19d90ff86267 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:39.877088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c0b2e57d-5ff2-48f8-9fa1-73591f1ce8e3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:39.877876 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c0b2e57d-5ff2-48f8-9fa1-73591f1ce8e3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:39.890409 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c0b2e57d-5ff2-48f8-9fa1-73591f1ce8e3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:39.891040 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c0b2e57d-5ff2-48f8-9fa1-73591f1ce8e3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:39.891848 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c0b2e57d-5ff2-48f8-9fa1-73591f1ce8e3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:39.892691 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c0b2e57d-5ff2-48f8-9fa1-73591f1ce8e3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:39.893221 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c0b2e57d-5ff2-48f8-9fa1-73591f1ce8e3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:39.893919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c0b2e57d-5ff2-48f8-9fa1-73591f1ce8e3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:40.156349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-41c3685c-1a96-40b9-8e40-19d90ff86267 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:40.157908 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c0b2e57d-5ff2-48f8-9fa1-73591f1ce8e3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:40.177195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-41c3685c-1a96-40b9-8e40-19d90ff86267 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.343980 Sep 01 14:03:40.177549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c0b2e57d-5ff2-48f8-9fa1-73591f1ce8e3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:40.179757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 182/362] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:39 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:40.181119 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c0b2e57d-5ff2-48f8-9fa1-73591f1ce8e3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:40.183958 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c0b2e57d-5ff2-48f8-9fa1-73591f1ce8e3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1750 microversion: 2.20 time: 0.312012 Sep 01 14:03:40.190726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-759c09a8-e54c-4bab-996d-521e5105be81 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:40.192463 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-759c09a8-e54c-4bab-996d-521e5105be81 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:40.196546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 181/363] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:39 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1750 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:40.210304 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-759c09a8-e54c-4bab-996d-521e5105be81 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:40.211848 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-759c09a8-e54c-4bab-996d-521e5105be81 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:40.212482 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-759c09a8-e54c-4bab-996d-521e5105be81 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:40.214304 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-759c09a8-e54c-4bab-996d-521e5105be81 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:40.215497 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-759c09a8-e54c-4bab-996d-521e5105be81 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:40.216349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-759c09a8-e54c-4bab-996d-521e5105be81 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:40.419293 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-759c09a8-e54c-4bab-996d-521e5105be81 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:40.428683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-759c09a8-e54c-4bab-996d-521e5105be81 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.246761 Sep 01 14:03:40.431277 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 183/364] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:40 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:40.453807 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a8ec845d-3138-42c9-a7c1-f609d541b274 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:40.454801 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a8ec845d-3138-42c9-a7c1-f609d541b274 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:40.465990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a8ec845d-3138-42c9-a7c1-f609d541b274 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:40.466889 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a8ec845d-3138-42c9-a7c1-f609d541b274 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:40.467658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a8ec845d-3138-42c9-a7c1-f609d541b274 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:40.468965 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a8ec845d-3138-42c9-a7c1-f609d541b274 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:40.469884 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a8ec845d-3138-42c9-a7c1-f609d541b274 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:40.470658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a8ec845d-3138-42c9-a7c1-f609d541b274 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:40.649675 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a8ec845d-3138-42c9-a7c1-f609d541b274 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:40.663242 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a8ec845d-3138-42c9-a7c1-f609d541b274 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.213268 Sep 01 14:03:40.678248 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 182/365] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:40 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:41.201289 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9d8f459d-eaa2-4306-90fd-66e5d959aee0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:41.205039 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9d8f459d-eaa2-4306-90fd-66e5d959aee0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:41.209518 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9d8f459d-eaa2-4306-90fd-66e5d959aee0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:41.210064 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9d8f459d-eaa2-4306-90fd-66e5d959aee0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:41.210638 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9d8f459d-eaa2-4306-90fd-66e5d959aee0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:41.211543 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9d8f459d-eaa2-4306-90fd-66e5d959aee0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:41.212004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9d8f459d-eaa2-4306-90fd-66e5d959aee0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:41.212427 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9d8f459d-eaa2-4306-90fd-66e5d959aee0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:41.214507 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8de0f53f-5035-4ff5-9652-4a200b9a3acb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:41.215342 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8de0f53f-5035-4ff5-9652-4a200b9a3acb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:41.217591 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:41.230233 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8de0f53f-5035-4ff5-9652-4a200b9a3acb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:41.233302 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8de0f53f-5035-4ff5-9652-4a200b9a3acb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:41.234578 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8de0f53f-5035-4ff5-9652-4a200b9a3acb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:41.240978 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8de0f53f-5035-4ff5-9652-4a200b9a3acb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:41.241659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8de0f53f-5035-4ff5-9652-4a200b9a3acb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:41.242923 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8de0f53f-5035-4ff5-9652-4a200b9a3acb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:41.535830 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9d8f459d-eaa2-4306-90fd-66e5d959aee0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:41.544655 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9d8f459d-eaa2-4306-90fd-66e5d959aee0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.347890 Sep 01 14:03:41.545236 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 184/366] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:41 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:41.551260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a94bab24-1b5c-4dbc-8963-580c01eff33e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:41.551962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8de0f53f-5035-4ff5-9652-4a200b9a3acb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:41.552198 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a94bab24-1b5c-4dbc-8963-580c01eff33e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:41.558894 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a94bab24-1b5c-4dbc-8963-580c01eff33e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:41.559479 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a94bab24-1b5c-4dbc-8963-580c01eff33e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:41.560029 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a94bab24-1b5c-4dbc-8963-580c01eff33e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:41.560818 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a94bab24-1b5c-4dbc-8963-580c01eff33e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:41.561349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a94bab24-1b5c-4dbc-8963-580c01eff33e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:41.561879 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a94bab24-1b5c-4dbc-8963-580c01eff33e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:41.575334 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8de0f53f-5035-4ff5-9652-4a200b9a3acb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:41.576886 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8de0f53f-5035-4ff5-9652-4a200b9a3acb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:41.578172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8de0f53f-5035-4ff5-9652-4a200b9a3acb tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1750 microversion: 2.20 time: 0.367935 Sep 01 14:03:41.579108 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 183/367] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:41 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1750 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:41.688098 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-76e5e17f-9a54-4ad7-90a1-9086ba2e7243 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:41.690077 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-76e5e17f-9a54-4ad7-90a1-9086ba2e7243 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:41.701228 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76e5e17f-9a54-4ad7-90a1-9086ba2e7243 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:41.701976 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76e5e17f-9a54-4ad7-90a1-9086ba2e7243 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:41.702522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76e5e17f-9a54-4ad7-90a1-9086ba2e7243 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:41.703727 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76e5e17f-9a54-4ad7-90a1-9086ba2e7243 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:41.704259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76e5e17f-9a54-4ad7-90a1-9086ba2e7243 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:41.704816 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76e5e17f-9a54-4ad7-90a1-9086ba2e7243 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:41.732783 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a94bab24-1b5c-4dbc-8963-580c01eff33e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:41.753889 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a94bab24-1b5c-4dbc-8963-580c01eff33e tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.207129 Sep 01 14:03:41.766266 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 185/368] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:41 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:41.948483 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-76e5e17f-9a54-4ad7-90a1-9086ba2e7243 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:41.958727 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-76e5e17f-9a54-4ad7-90a1-9086ba2e7243 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.276670 Sep 01 14:03:41.961339 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 184/369] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:41 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:42.577866 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-23da574d-f052-4596-af51-68e89d58fcaa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:42.579416 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-23da574d-f052-4596-af51-68e89d58fcaa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:42.590752 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-23da574d-f052-4596-af51-68e89d58fcaa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:42.591266 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-23da574d-f052-4596-af51-68e89d58fcaa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:42.591717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-23da574d-f052-4596-af51-68e89d58fcaa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:42.592453 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-23da574d-f052-4596-af51-68e89d58fcaa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:42.592919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-23da574d-f052-4596-af51-68e89d58fcaa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:42.593346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-23da574d-f052-4596-af51-68e89d58fcaa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:42.610449 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-70335208-05b0-4f6c-9200-a74beb7c6166 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:42.611442 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-70335208-05b0-4f6c-9200-a74beb7c6166 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:42.629598 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-70335208-05b0-4f6c-9200-a74beb7c6166 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:42.630783 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-70335208-05b0-4f6c-9200-a74beb7c6166 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:42.631848 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-70335208-05b0-4f6c-9200-a74beb7c6166 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:42.633520 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-70335208-05b0-4f6c-9200-a74beb7c6166 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:42.647488 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-70335208-05b0-4f6c-9200-a74beb7c6166 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:42.652715 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-70335208-05b0-4f6c-9200-a74beb7c6166 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:42.881328 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=10 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:42.960037 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-23da574d-f052-4596-af51-68e89d58fcaa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:42.976692 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-70335208-05b0-4f6c-9200-a74beb7c6166 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:42.981925 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-23da574d-f052-4596-af51-68e89d58fcaa tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.411652 Sep 01 14:03:42.983299 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 186/370] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:42 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:42.987490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-70335208-05b0-4f6c-9200-a74beb7c6166 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:42.989330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-70335208-05b0-4f6c-9200-a74beb7c6166 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:42.990953 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-70335208-05b0-4f6c-9200-a74beb7c6166 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1750 microversion: 2.20 time: 0.388889 Sep 01 14:03:42.992046 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 185/371] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:42 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1750 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:42.999555 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-be909ab4-54c4-4463-9eb4-bf1d5e3a373a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:43.000465 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-be909ab4-54c4-4463-9eb4-bf1d5e3a373a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:43.004532 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d9e656f1-adb9-4f56-afec-14b9eb2e2ec2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:43.008151 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be909ab4-54c4-4463-9eb4-bf1d5e3a373a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:43.008914 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be909ab4-54c4-4463-9eb4-bf1d5e3a373a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:43.009533 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be909ab4-54c4-4463-9eb4-bf1d5e3a373a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:43.010470 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be909ab4-54c4-4463-9eb4-bf1d5e3a373a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:43.011369 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be909ab4-54c4-4463-9eb4-bf1d5e3a373a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:43.011985 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be909ab4-54c4-4463-9eb4-bf1d5e3a373a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:43.019204 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d9e656f1-adb9-4f56-afec-14b9eb2e2ec2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:43.068945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d9e656f1-adb9-4f56-afec-14b9eb2e2ec2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:43.070073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d9e656f1-adb9-4f56-afec-14b9eb2e2ec2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:43.071034 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d9e656f1-adb9-4f56-afec-14b9eb2e2ec2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:43.072491 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d9e656f1-adb9-4f56-afec-14b9eb2e2ec2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:43.073504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d9e656f1-adb9-4f56-afec-14b9eb2e2ec2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:43.074456 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d9e656f1-adb9-4f56-afec-14b9eb2e2ec2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:43.300317 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-be909ab4-54c4-4463-9eb4-bf1d5e3a373a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:43.312494 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-be909ab4-54c4-4463-9eb4-bf1d5e3a373a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.319034 Sep 01 14:03:43.321496 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 186/372] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:42 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:43.376752 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d9e656f1-adb9-4f56-afec-14b9eb2e2ec2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:43.390152 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d9e656f1-adb9-4f56-afec-14b9eb2e2ec2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.401381 Sep 01 14:03:43.390680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 187/373] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:42 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:44.040775 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c0540a6c-da7f-4b61-bbbd-f871fa0c862e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:44.042077 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c0540a6c-da7f-4b61-bbbd-f871fa0c862e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:44.042559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-25697635-0127-4c80-8b34-00a52d62765f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:44.043977 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-25697635-0127-4c80-8b34-00a52d62765f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:44.057003 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0540a6c-da7f-4b61-bbbd-f871fa0c862e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:44.057579 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0540a6c-da7f-4b61-bbbd-f871fa0c862e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:44.057762 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-25697635-0127-4c80-8b34-00a52d62765f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:44.058316 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0540a6c-da7f-4b61-bbbd-f871fa0c862e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:44.058576 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-25697635-0127-4c80-8b34-00a52d62765f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:44.059170 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0540a6c-da7f-4b61-bbbd-f871fa0c862e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:44.059696 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0540a6c-da7f-4b61-bbbd-f871fa0c862e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:44.060103 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-25697635-0127-4c80-8b34-00a52d62765f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:44.061577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-25697635-0127-4c80-8b34-00a52d62765f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:44.062294 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0540a6c-da7f-4b61-bbbd-f871fa0c862e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:44.062502 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-25697635-0127-4c80-8b34-00a52d62765f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:44.062952 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-25697635-0127-4c80-8b34-00a52d62765f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:44.090798 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:44.466980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c0540a6c-da7f-4b61-bbbd-f871fa0c862e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:44.475635 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-25697635-0127-4c80-8b34-00a52d62765f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:44.493611 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-25697635-0127-4c80-8b34-00a52d62765f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:44.495165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-25697635-0127-4c80-8b34-00a52d62765f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:44.496415 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-25697635-0127-4c80-8b34-00a52d62765f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1750 microversion: 2.20 time: 0.462066 Sep 01 14:03:44.496984 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 187/374] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:44 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1750 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:44.499366 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c0540a6c-da7f-4b61-bbbd-f871fa0c862e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.463123 Sep 01 14:03:44.500441 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 188/375] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:44 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:44.516414 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9d10db3a-a21b-4897-b8ae-74f10646bd9b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:44.517972 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9d10db3a-a21b-4897-b8ae-74f10646bd9b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:44.532313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3dfe0e8c-8357-4c1c-a711-6825a18b9e35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:44.534529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9d10db3a-a21b-4897-b8ae-74f10646bd9b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:44.534826 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3dfe0e8c-8357-4c1c-a711-6825a18b9e35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:44.535488 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9d10db3a-a21b-4897-b8ae-74f10646bd9b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:44.536221 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9d10db3a-a21b-4897-b8ae-74f10646bd9b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:44.537405 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9d10db3a-a21b-4897-b8ae-74f10646bd9b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:44.538241 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9d10db3a-a21b-4897-b8ae-74f10646bd9b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:44.538971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9d10db3a-a21b-4897-b8ae-74f10646bd9b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:44.548784 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3dfe0e8c-8357-4c1c-a711-6825a18b9e35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:44.552394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3dfe0e8c-8357-4c1c-a711-6825a18b9e35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:44.552394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3dfe0e8c-8357-4c1c-a711-6825a18b9e35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:44.553613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3dfe0e8c-8357-4c1c-a711-6825a18b9e35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:44.554701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3dfe0e8c-8357-4c1c-a711-6825a18b9e35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:44.557627 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3dfe0e8c-8357-4c1c-a711-6825a18b9e35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:45.100932 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9d10db3a-a21b-4897-b8ae-74f10646bd9b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:45.101632 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3dfe0e8c-8357-4c1c-a711-6825a18b9e35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:45.110484 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3dfe0e8c-8357-4c1c-a711-6825a18b9e35 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.594509 Sep 01 14:03:45.111377 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 189/376] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:44 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:45.117224 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9d10db3a-a21b-4897-b8ae-74f10646bd9b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.618538 Sep 01 14:03:45.118631 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 188/377] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:44 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:45.527129 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1245ee93-9f4a-45a0-b398-986ce33b641f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:45.527830 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1245ee93-9f4a-45a0-b398-986ce33b641f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:45.534764 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1245ee93-9f4a-45a0-b398-986ce33b641f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:45.535252 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1245ee93-9f4a-45a0-b398-986ce33b641f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:45.535691 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1245ee93-9f4a-45a0-b398-986ce33b641f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:45.536384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1245ee93-9f4a-45a0-b398-986ce33b641f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:45.536871 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1245ee93-9f4a-45a0-b398-986ce33b641f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:45.537342 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1245ee93-9f4a-45a0-b398-986ce33b641f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:45.539117 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-82628a4b-fa1a-4718-8bd6-5ea0fb4b3c50 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:45.540042 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-82628a4b-fa1a-4718-8bd6-5ea0fb4b3c50 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:45.550405 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-82628a4b-fa1a-4718-8bd6-5ea0fb4b3c50 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:45.551391 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-82628a4b-fa1a-4718-8bd6-5ea0fb4b3c50 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:45.552270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-82628a4b-fa1a-4718-8bd6-5ea0fb4b3c50 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:45.553637 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-82628a4b-fa1a-4718-8bd6-5ea0fb4b3c50 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:45.556128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-82628a4b-fa1a-4718-8bd6-5ea0fb4b3c50 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:45.557038 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-82628a4b-fa1a-4718-8bd6-5ea0fb4b3c50 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:45.778117 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1245ee93-9f4a-45a0-b398-986ce33b641f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:45.791825 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1245ee93-9f4a-45a0-b398-986ce33b641f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:45.797075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1245ee93-9f4a-45a0-b398-986ce33b641f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:45.799694 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1245ee93-9f4a-45a0-b398-986ce33b641f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1750 microversion: 2.20 time: 0.278352 Sep 01 14:03:45.808887 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 190/378] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:45 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1750 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:45.828692 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-82628a4b-fa1a-4718-8bd6-5ea0fb4b3c50 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:45.837982 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-82628a4b-fa1a-4718-8bd6-5ea0fb4b3c50 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.304789 Sep 01 14:03:45.838588 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 189/379] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:45 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:46.139213 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9603fe2c-7ea6-4be1-b441-2baa2bbffc5a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:46.140317 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9603fe2c-7ea6-4be1-b441-2baa2bbffc5a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:46.148699 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9603fe2c-7ea6-4be1-b441-2baa2bbffc5a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:46.149185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9603fe2c-7ea6-4be1-b441-2baa2bbffc5a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:46.149620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9603fe2c-7ea6-4be1-b441-2baa2bbffc5a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:46.150357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9603fe2c-7ea6-4be1-b441-2baa2bbffc5a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:46.150807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9603fe2c-7ea6-4be1-b441-2baa2bbffc5a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:46.151226 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9603fe2c-7ea6-4be1-b441-2baa2bbffc5a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:46.158026 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1f51a8be-a74a-4833-802f-56f18c0097b5 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:46.166977 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1f51a8be-a74a-4833-802f-56f18c0097b5 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:46.166977 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1f51a8be-a74a-4833-802f-56f18c0097b5 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:46.167491 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1f51a8be-a74a-4833-802f-56f18c0097b5 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:46.167940 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1f51a8be-a74a-4833-802f-56f18c0097b5 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:46.168658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1f51a8be-a74a-4833-802f-56f18c0097b5 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:46.169311 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1f51a8be-a74a-4833-802f-56f18c0097b5 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:46.169750 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1f51a8be-a74a-4833-802f-56f18c0097b5 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:46.454835 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9603fe2c-7ea6-4be1-b441-2baa2bbffc5a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:46.461006 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1f51a8be-a74a-4833-802f-56f18c0097b5 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:46.469020 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9603fe2c-7ea6-4be1-b441-2baa2bbffc5a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.337556 Sep 01 14:03:46.469806 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 191/380] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:46 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:46.475748 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1f51a8be-a74a-4833-802f-56f18c0097b5 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.321556 Sep 01 14:03:46.476768 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 190/381] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:46 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:46.835798 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-adb90d3b-548b-43a5-afc0-fe6533b1663c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:46.836636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-adb90d3b-548b-43a5-afc0-fe6533b1663c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:46.843603 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-adb90d3b-548b-43a5-afc0-fe6533b1663c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:46.845454 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-adb90d3b-548b-43a5-afc0-fe6533b1663c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:46.845985 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-adb90d3b-548b-43a5-afc0-fe6533b1663c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:46.846784 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-adb90d3b-548b-43a5-afc0-fe6533b1663c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:46.847256 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-adb90d3b-548b-43a5-afc0-fe6533b1663c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:46.847696 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-adb90d3b-548b-43a5-afc0-fe6533b1663c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:46.864306 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-bee75942-4d58-4fb6-ab8e-6cab3615b5df tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:46.865479 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-bee75942-4d58-4fb6-ab8e-6cab3615b5df tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:46.877435 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bee75942-4d58-4fb6-ab8e-6cab3615b5df tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:46.878336 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bee75942-4d58-4fb6-ab8e-6cab3615b5df tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:46.879136 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bee75942-4d58-4fb6-ab8e-6cab3615b5df tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:46.880453 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bee75942-4d58-4fb6-ab8e-6cab3615b5df tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:46.881675 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bee75942-4d58-4fb6-ab8e-6cab3615b5df tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:46.882730 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bee75942-4d58-4fb6-ab8e-6cab3615b5df tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:47.145046 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-adb90d3b-548b-43a5-afc0-fe6533b1663c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:47.145046 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-adb90d3b-548b-43a5-afc0-fe6533b1663c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:47.146977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-adb90d3b-548b-43a5-afc0-fe6533b1663c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:47.146977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-adb90d3b-548b-43a5-afc0-fe6533b1663c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1750 microversion: 2.20 time: 0.300620 Sep 01 14:03:47.147172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-bee75942-4d58-4fb6-ab8e-6cab3615b5df tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:47.147296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 192/382] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:46 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1750 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:47.150093 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-bee75942-4d58-4fb6-ab8e-6cab3615b5df tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.293142 Sep 01 14:03:47.150733 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 191/383] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:46 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:47.498325 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b9c2df5a-e0d0-4f49-9baf-6b76d0df69e2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:47.499223 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b9c2df5a-e0d0-4f49-9baf-6b76d0df69e2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:47.504144 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a5273578-51b1-4095-9a27-b7661893a8a6 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:47.507411 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a5273578-51b1-4095-9a27-b7661893a8a6 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:47.507533 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b9c2df5a-e0d0-4f49-9baf-6b76d0df69e2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:47.507533 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b9c2df5a-e0d0-4f49-9baf-6b76d0df69e2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:47.507738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b9c2df5a-e0d0-4f49-9baf-6b76d0df69e2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:47.508266 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b9c2df5a-e0d0-4f49-9baf-6b76d0df69e2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:47.508715 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b9c2df5a-e0d0-4f49-9baf-6b76d0df69e2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:47.509133 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b9c2df5a-e0d0-4f49-9baf-6b76d0df69e2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:47.511507 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a5273578-51b1-4095-9a27-b7661893a8a6 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:47.511991 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a5273578-51b1-4095-9a27-b7661893a8a6 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:47.512426 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a5273578-51b1-4095-9a27-b7661893a8a6 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:47.513123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a5273578-51b1-4095-9a27-b7661893a8a6 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:47.513578 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a5273578-51b1-4095-9a27-b7661893a8a6 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:47.514075 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a5273578-51b1-4095-9a27-b7661893a8a6 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:47.716140 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-b9c2df5a-e0d0-4f49-9baf-6b76d0df69e2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:47.719624 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a5273578-51b1-4095-9a27-b7661893a8a6 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:47.724400 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b9c2df5a-e0d0-4f49-9baf-6b76d0df69e2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.230115 Sep 01 14:03:47.725598 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 193/384] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:47 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:47.728159 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a5273578-51b1-4095-9a27-b7661893a8a6 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.227946 Sep 01 14:03:47.728738 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 192/385] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:47 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:48.158161 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-29586453-0392-452e-bf28-5cc7b3f5fa5c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:48.158161 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-29586453-0392-452e-bf28-5cc7b3f5fa5c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:48.163894 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-29586453-0392-452e-bf28-5cc7b3f5fa5c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:48.164394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-29586453-0392-452e-bf28-5cc7b3f5fa5c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:48.164875 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-29586453-0392-452e-bf28-5cc7b3f5fa5c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:48.167897 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-29586453-0392-452e-bf28-5cc7b3f5fa5c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:48.167897 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-29586453-0392-452e-bf28-5cc7b3f5fa5c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:48.167897 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-29586453-0392-452e-bf28-5cc7b3f5fa5c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:48.180306 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-03be5a0c-dcb5-4ade-815e-4bf4607a4553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:48.182543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-03be5a0c-dcb5-4ade-815e-4bf4607a4553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:48.196112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-03be5a0c-dcb5-4ade-815e-4bf4607a4553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:48.197043 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-03be5a0c-dcb5-4ade-815e-4bf4607a4553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:48.198124 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-03be5a0c-dcb5-4ade-815e-4bf4607a4553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:48.199385 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-03be5a0c-dcb5-4ade-815e-4bf4607a4553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:48.200747 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-03be5a0c-dcb5-4ade-815e-4bf4607a4553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:48.201420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-03be5a0c-dcb5-4ade-815e-4bf4607a4553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:48.209669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:48.486685 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-29586453-0392-452e-bf28-5cc7b3f5fa5c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:48.496451 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-29586453-0392-452e-bf28-5cc7b3f5fa5c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:48.498316 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-29586453-0392-452e-bf28-5cc7b3f5fa5c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:48.499610 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-29586453-0392-452e-bf28-5cc7b3f5fa5c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1750 microversion: 2.20 time: 0.348348 Sep 01 14:03:48.500189 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 194/386] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:48 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1750 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:48.514461 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-03be5a0c-dcb5-4ade-815e-4bf4607a4553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:48.522707 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-03be5a0c-dcb5-4ade-815e-4bf4607a4553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.352320 Sep 01 14:03:48.523285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 193/387] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:48 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:48.750217 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0c8bc07c-b33d-4891-b0ee-4c9afa96e1f3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:48.751226 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0c8bc07c-b33d-4891-b0ee-4c9afa96e1f3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:48.751721 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5666454b-4830-4ecd-8522-128aab815968 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:48.752729 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5666454b-4830-4ecd-8522-128aab815968 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:48.761991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c8bc07c-b33d-4891-b0ee-4c9afa96e1f3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:48.762510 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5666454b-4830-4ecd-8522-128aab815968 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:48.762803 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c8bc07c-b33d-4891-b0ee-4c9afa96e1f3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:48.763322 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5666454b-4830-4ecd-8522-128aab815968 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:48.763525 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c8bc07c-b33d-4891-b0ee-4c9afa96e1f3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:48.764020 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5666454b-4830-4ecd-8522-128aab815968 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:48.764682 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c8bc07c-b33d-4891-b0ee-4c9afa96e1f3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:48.765353 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5666454b-4830-4ecd-8522-128aab815968 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:48.765473 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c8bc07c-b33d-4891-b0ee-4c9afa96e1f3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:48.766152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5666454b-4830-4ecd-8522-128aab815968 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:48.766266 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c8bc07c-b33d-4891-b0ee-4c9afa96e1f3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:48.766846 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5666454b-4830-4ecd-8522-128aab815968 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:48.988466 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5666454b-4830-4ecd-8522-128aab815968 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:48.992276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0c8bc07c-b33d-4891-b0ee-4c9afa96e1f3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:48.997048 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5666454b-4830-4ecd-8522-128aab815968 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.251983 Sep 01 14:03:48.998202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 194/388] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:48 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:49.000936 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0c8bc07c-b33d-4891-b0ee-4c9afa96e1f3 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.257528 Sep 01 14:03:49.001515 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 195/389] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:48 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:49.525065 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-badd930d-17ee-48ff-9db5-6c1525146690 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:49.525824 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-badd930d-17ee-48ff-9db5-6c1525146690 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:49.533624 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-badd930d-17ee-48ff-9db5-6c1525146690 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:49.534209 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-badd930d-17ee-48ff-9db5-6c1525146690 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:49.534660 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-badd930d-17ee-48ff-9db5-6c1525146690 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:49.535379 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-badd930d-17ee-48ff-9db5-6c1525146690 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:49.535870 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-badd930d-17ee-48ff-9db5-6c1525146690 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:49.536305 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-badd930d-17ee-48ff-9db5-6c1525146690 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:49.545539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cf0aec58-88be-4f36-b568-af257e38ec89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:49.546505 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-cf0aec58-88be-4f36-b568-af257e38ec89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:49.555027 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf0aec58-88be-4f36-b568-af257e38ec89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:49.555648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf0aec58-88be-4f36-b568-af257e38ec89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:49.556190 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf0aec58-88be-4f36-b568-af257e38ec89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:49.557125 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf0aec58-88be-4f36-b568-af257e38ec89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:49.557633 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf0aec58-88be-4f36-b568-af257e38ec89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:49.558132 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf0aec58-88be-4f36-b568-af257e38ec89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:49.758267 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-badd930d-17ee-48ff-9db5-6c1525146690 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:49.768958 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-badd930d-17ee-48ff-9db5-6c1525146690 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:49.770698 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-badd930d-17ee-48ff-9db5-6c1525146690 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:49.772908 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-badd930d-17ee-48ff-9db5-6c1525146690 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1750 microversion: 2.20 time: 0.252929 Sep 01 14:03:49.773185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cf0aec58-88be-4f36-b568-af257e38ec89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:49.773819 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 195/390] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:49 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1750 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:49.788048 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cf0aec58-88be-4f36-b568-af257e38ec89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.246269 Sep 01 14:03:49.789056 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 196/391] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:49 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:50.021803 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-72a7a79d-f9d2-4ffc-a1be-92ceaad1bf2f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:50.022895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-72a7a79d-f9d2-4ffc-a1be-92ceaad1bf2f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:50.028077 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d7d84578-676e-4803-8c61-cefff3802e0a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:50.029100 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d7d84578-676e-4803-8c61-cefff3802e0a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:50.033586 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-72a7a79d-f9d2-4ffc-a1be-92ceaad1bf2f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:50.034390 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-72a7a79d-f9d2-4ffc-a1be-92ceaad1bf2f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:50.035101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-72a7a79d-f9d2-4ffc-a1be-92ceaad1bf2f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:50.036252 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-72a7a79d-f9d2-4ffc-a1be-92ceaad1bf2f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:50.037079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-72a7a79d-f9d2-4ffc-a1be-92ceaad1bf2f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:50.037818 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-72a7a79d-f9d2-4ffc-a1be-92ceaad1bf2f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:50.039455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7d84578-676e-4803-8c61-cefff3802e0a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:50.040163 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7d84578-676e-4803-8c61-cefff3802e0a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:50.040879 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7d84578-676e-4803-8c61-cefff3802e0a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:50.042039 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7d84578-676e-4803-8c61-cefff3802e0a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:50.042835 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7d84578-676e-4803-8c61-cefff3802e0a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:50.043528 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7d84578-676e-4803-8c61-cefff3802e0a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:50.388516 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-72a7a79d-f9d2-4ffc-a1be-92ceaad1bf2f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:50.413870 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-72a7a79d-f9d2-4ffc-a1be-92ceaad1bf2f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.393553 Sep 01 14:03:50.415460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 196/392] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:50 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:50.450110 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d7d84578-676e-4803-8c61-cefff3802e0a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:50.459830 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d7d84578-676e-4803-8c61-cefff3802e0a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.440659 Sep 01 14:03:50.460930 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 197/393] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:50 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:50.797152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3bc8a449-1736-44a3-a1b9-f9811219a74f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:50.797931 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3bc8a449-1736-44a3-a1b9-f9811219a74f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:50.810128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3bc8a449-1736-44a3-a1b9-f9811219a74f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:50.810834 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3bc8a449-1736-44a3-a1b9-f9811219a74f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:50.811340 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3bc8a449-1736-44a3-a1b9-f9811219a74f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:50.812094 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3bc8a449-1736-44a3-a1b9-f9811219a74f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:50.812555 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3bc8a449-1736-44a3-a1b9-f9811219a74f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:50.812978 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3bc8a449-1736-44a3-a1b9-f9811219a74f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:50.823175 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d3d2204c-5838-4a71-a535-8eef4c84d7db tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:50.825116 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d3d2204c-5838-4a71-a535-8eef4c84d7db tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:50.833104 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d3d2204c-5838-4a71-a535-8eef4c84d7db tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:50.833640 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d3d2204c-5838-4a71-a535-8eef4c84d7db tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:50.834141 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d3d2204c-5838-4a71-a535-8eef4c84d7db tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:50.834902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d3d2204c-5838-4a71-a535-8eef4c84d7db tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:50.835564 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d3d2204c-5838-4a71-a535-8eef4c84d7db tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:50.835995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d3d2204c-5838-4a71-a535-8eef4c84d7db tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:51.184015 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d3d2204c-5838-4a71-a535-8eef4c84d7db tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:51.188875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3bc8a449-1736-44a3-a1b9-f9811219a74f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:51.194501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d3d2204c-5838-4a71-a535-8eef4c84d7db tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.377528 Sep 01 14:03:51.208306 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 198/394] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:50 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:51.209684 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3bc8a449-1736-44a3-a1b9-f9811219a74f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:51.209684 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3bc8a449-1736-44a3-a1b9-f9811219a74f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:51.209684 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3bc8a449-1736-44a3-a1b9-f9811219a74f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1750 microversion: 2.20 time: 0.414397 Sep 01 14:03:51.210294 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 197/395] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:50 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1750 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:51.446011 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-40f5fd2e-2ac3-47d3-aedc-56dbc9477270 req-904c6f76-bf57-4f45-accf-e817caeaa503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d699cea-9245-405e-87bb-0c9e6af9391b", "tag": "095e75e8-b9ca-4c49-8292-9f9586ad794f"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:51.456500 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-40f5fd2e-2ac3-47d3-aedc-56dbc9477270 req-904c6f76-bf57-4f45-accf-e817caeaa503 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:51.456825 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c178e82c-c5d5-4f82-b1b8-aeff273dabb7 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:51.457018 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-40f5fd2e-2ac3-47d3-aedc-56dbc9477270 req-904c6f76-bf57-4f45-accf-e817caeaa503 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:51.457387 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-40f5fd2e-2ac3-47d3-aedc-56dbc9477270 req-904c6f76-bf57-4f45-accf-e817caeaa503 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:51.457698 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c178e82c-c5d5-4f82-b1b8-aeff273dabb7 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:51.478203 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c178e82c-c5d5-4f82-b1b8-aeff273dabb7 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:51.478710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c178e82c-c5d5-4f82-b1b8-aeff273dabb7 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:51.479166 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c178e82c-c5d5-4f82-b1b8-aeff273dabb7 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:51.480017 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c178e82c-c5d5-4f82-b1b8-aeff273dabb7 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:51.480546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c178e82c-c5d5-4f82-b1b8-aeff273dabb7 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:51.480988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c178e82c-c5d5-4f82-b1b8-aeff273dabb7 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:51.482313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-40f5fd2e-2ac3-47d3-aedc-56dbc9477270 req-904c6f76-bf57-4f45-accf-e817caeaa503 service nova] Creating event network-changed:095e75e8-b9ca-4c49-8292-9f9586ad794f for instance 4d699cea-9245-405e-87bb-0c9e6af9391b on hv-cinder-85221 Sep 01 14:03:51.488276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-40f5fd2e-2ac3-47d3-aedc-56dbc9477270 req-904c6f76-bf57-4f45-accf-e817caeaa503 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046460 Sep 01 14:03:51.488877 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 199/396] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:51.495055 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-dc7b1e8e-d34f-40f2-8f61-ec53c63d0f95 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:51.495774 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-dc7b1e8e-d34f-40f2-8f61-ec53c63d0f95 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:51.502653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc7b1e8e-d34f-40f2-8f61-ec53c63d0f95 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:51.504500 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc7b1e8e-d34f-40f2-8f61-ec53c63d0f95 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:51.504500 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc7b1e8e-d34f-40f2-8f61-ec53c63d0f95 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:51.505017 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc7b1e8e-d34f-40f2-8f61-ec53c63d0f95 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:51.506240 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc7b1e8e-d34f-40f2-8f61-ec53c63d0f95 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:51.506864 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc7b1e8e-d34f-40f2-8f61-ec53c63d0f95 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:51.856847 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c178e82c-c5d5-4f82-b1b8-aeff273dabb7 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:51.870626 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c178e82c-c5d5-4f82-b1b8-aeff273dabb7 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.419745 Sep 01 14:03:51.882282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 198/397] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:51 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:51.882779 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-dc7b1e8e-d34f-40f2-8f61-ec53c63d0f95 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:51.905150 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-dc7b1e8e-d34f-40f2-8f61-ec53c63d0f95 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.402998 Sep 01 14:03:51.905150 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 200/398] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:51 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:52.219372 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c331a9e8-513b-4eb5-984d-44d33a923981 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:52.220243 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c331a9e8-513b-4eb5-984d-44d33a923981 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:52.229414 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c331a9e8-513b-4eb5-984d-44d33a923981 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:52.229942 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c331a9e8-513b-4eb5-984d-44d33a923981 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:52.230554 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c331a9e8-513b-4eb5-984d-44d33a923981 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:52.231088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c331a9e8-513b-4eb5-984d-44d33a923981 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:52.231546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c331a9e8-513b-4eb5-984d-44d33a923981 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:52.232153 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c331a9e8-513b-4eb5-984d-44d33a923981 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:52.234344 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1b204436-c8c3-4e1c-89fc-7f4b3b332998 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:52.235043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1b204436-c8c3-4e1c-89fc-7f4b3b332998 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:52.251203 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1b204436-c8c3-4e1c-89fc-7f4b3b332998 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:52.251689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1b204436-c8c3-4e1c-89fc-7f4b3b332998 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:52.252337 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1b204436-c8c3-4e1c-89fc-7f4b3b332998 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:52.253286 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1b204436-c8c3-4e1c-89fc-7f4b3b332998 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:52.253744 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1b204436-c8c3-4e1c-89fc-7f4b3b332998 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:52.260107 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1b204436-c8c3-4e1c-89fc-7f4b3b332998 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:52.457562 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1b204436-c8c3-4e1c-89fc-7f4b3b332998 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:52.463382 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c331a9e8-513b-4eb5-984d-44d33a923981 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:52.468359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1b204436-c8c3-4e1c-89fc-7f4b3b332998 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:52.470322 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1b204436-c8c3-4e1c-89fc-7f4b3b332998 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:52.471844 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1b204436-c8c3-4e1c-89fc-7f4b3b332998 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1750 microversion: 2.20 time: 0.243576 Sep 01 14:03:52.479144 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c331a9e8-513b-4eb5-984d-44d33a923981 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.265862 Sep 01 14:03:52.494996 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 199/399] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:52 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:52.499886 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 201/400] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:52 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1750 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:52.913098 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c6f83c54-2b5b-4ed4-8cf0-76b99f6e00c1 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:52.915210 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c6f83c54-2b5b-4ed4-8cf0-76b99f6e00c1 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:52.929754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6f83c54-2b5b-4ed4-8cf0-76b99f6e00c1 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:52.931080 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6f83c54-2b5b-4ed4-8cf0-76b99f6e00c1 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:52.931438 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-709567c2-db19-43f3-a411-433ab88f374c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:52.932169 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6f83c54-2b5b-4ed4-8cf0-76b99f6e00c1 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:52.932298 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-709567c2-db19-43f3-a411-433ab88f374c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:52.933562 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6f83c54-2b5b-4ed4-8cf0-76b99f6e00c1 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:52.934713 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6f83c54-2b5b-4ed4-8cf0-76b99f6e00c1 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:52.935735 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c6f83c54-2b5b-4ed4-8cf0-76b99f6e00c1 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:52.944511 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-709567c2-db19-43f3-a411-433ab88f374c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:52.945185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-709567c2-db19-43f3-a411-433ab88f374c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:52.945758 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-709567c2-db19-43f3-a411-433ab88f374c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:52.946650 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-709567c2-db19-43f3-a411-433ab88f374c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:52.947165 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-709567c2-db19-43f3-a411-433ab88f374c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:52.947887 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-709567c2-db19-43f3-a411-433ab88f374c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:53.263983 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-709567c2-db19-43f3-a411-433ab88f374c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:53.274546 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-709567c2-db19-43f3-a411-433ab88f374c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.349596 Sep 01 14:03:53.287978 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c6f83c54-2b5b-4ed4-8cf0-76b99f6e00c1 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:53.292137 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 202/401] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:52 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:53.295374 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-65614fc1-8724-47f8-a9b8-135a117ac28f req-fd0ddd06-2974-43ef-9e10-046907cb82cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58", "name": "network-vif-plugged", "status": "completed", "tag": "ae65f105-61e5-40e0-a2ad-e0283df21835"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:03:53.299052 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c6f83c54-2b5b-4ed4-8cf0-76b99f6e00c1 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.394007 Sep 01 14:03:53.312396 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 200/402] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:52 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:53.322509 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-65614fc1-8724-47f8-a9b8-135a117ac28f req-fd0ddd06-2974-43ef-9e10-046907cb82cd service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:53.323099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-65614fc1-8724-47f8-a9b8-135a117ac28f req-fd0ddd06-2974-43ef-9e10-046907cb82cd service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:53.326582 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-65614fc1-8724-47f8-a9b8-135a117ac28f req-fd0ddd06-2974-43ef-9e10-046907cb82cd service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:53.336231 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-65614fc1-8724-47f8-a9b8-135a117ac28f req-fd0ddd06-2974-43ef-9e10-046907cb82cd service nova] Creating event network-vif-plugged:ae65f105-61e5-40e0-a2ad-e0283df21835 for instance 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 on hv-cinder-85221 Sep 01 14:03:53.341297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-65614fc1-8724-47f8-a9b8-135a117ac28f req-fd0ddd06-2974-43ef-9e10-046907cb82cd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050604 Sep 01 14:03:53.342344 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 203/403] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:03:53.500548 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2ed8f21f-912d-4ad1-91fe-5c892ce80e60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:53.501511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2ed8f21f-912d-4ad1-91fe-5c892ce80e60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:53.511908 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2ed8f21f-912d-4ad1-91fe-5c892ce80e60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:53.512407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2ed8f21f-912d-4ad1-91fe-5c892ce80e60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:53.512846 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2ed8f21f-912d-4ad1-91fe-5c892ce80e60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:53.513085 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b485907a-05cd-42cc-a64f-21780c8ebb84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:53.513881 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2ed8f21f-912d-4ad1-91fe-5c892ce80e60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:53.514005 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b485907a-05cd-42cc-a64f-21780c8ebb84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:53.514146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2ed8f21f-912d-4ad1-91fe-5c892ce80e60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:53.518670 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2ed8f21f-912d-4ad1-91fe-5c892ce80e60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:53.521881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b485907a-05cd-42cc-a64f-21780c8ebb84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:53.522382 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b485907a-05cd-42cc-a64f-21780c8ebb84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:53.522823 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b485907a-05cd-42cc-a64f-21780c8ebb84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:53.523552 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b485907a-05cd-42cc-a64f-21780c8ebb84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:53.524013 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b485907a-05cd-42cc-a64f-21780c8ebb84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:53.524474 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b485907a-05cd-42cc-a64f-21780c8ebb84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:53.748882 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2ed8f21f-912d-4ad1-91fe-5c892ce80e60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:53.761381 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2ed8f21f-912d-4ad1-91fe-5c892ce80e60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:53.763032 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2ed8f21f-912d-4ad1-91fe-5c892ce80e60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:53.763647 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-b485907a-05cd-42cc-a64f-21780c8ebb84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:53.764156 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2ed8f21f-912d-4ad1-91fe-5c892ce80e60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.268070 Sep 01 14:03:53.764813 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 201/404] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:53 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:53.777174 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b485907a-05cd-42cc-a64f-21780c8ebb84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.268046 Sep 01 14:03:53.778137 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 204/405] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:53 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:54.295879 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4a09f4e5-a7d2-4c04-ae59-b1a9e9847c1a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:54.296477 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4a09f4e5-a7d2-4c04-ae59-b1a9e9847c1a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:54.303045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4a09f4e5-a7d2-4c04-ae59-b1a9e9847c1a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:54.303523 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4a09f4e5-a7d2-4c04-ae59-b1a9e9847c1a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:54.303953 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4a09f4e5-a7d2-4c04-ae59-b1a9e9847c1a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:54.304654 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4a09f4e5-a7d2-4c04-ae59-b1a9e9847c1a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:54.305101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4a09f4e5-a7d2-4c04-ae59-b1a9e9847c1a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:54.305519 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4a09f4e5-a7d2-4c04-ae59-b1a9e9847c1a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:54.322018 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a3d0d7f2-1506-46d9-8c1b-06d11d42298c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:54.323047 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a3d0d7f2-1506-46d9-8c1b-06d11d42298c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:54.332864 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a3d0d7f2-1506-46d9-8c1b-06d11d42298c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:54.334070 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a3d0d7f2-1506-46d9-8c1b-06d11d42298c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:54.334618 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a3d0d7f2-1506-46d9-8c1b-06d11d42298c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:54.335491 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a3d0d7f2-1506-46d9-8c1b-06d11d42298c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:54.336080 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a3d0d7f2-1506-46d9-8c1b-06d11d42298c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:54.336619 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a3d0d7f2-1506-46d9-8c1b-06d11d42298c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:54.561970 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4a09f4e5-a7d2-4c04-ae59-b1a9e9847c1a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:54.570941 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4a09f4e5-a7d2-4c04-ae59-b1a9e9847c1a tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.278845 Sep 01 14:03:54.571751 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 202/406] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:54 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:54.585660 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a3d0d7f2-1506-46d9-8c1b-06d11d42298c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:54.589569 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a3d0d7f2-1506-46d9-8c1b-06d11d42298c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.273209 Sep 01 14:03:54.590183 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 205/407] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:54 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:54.821198 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-19fb709e-43fb-4a13-b69a-d01c09ba173b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:54.823318 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-04b4cfc4-9218-401d-97f4-6740a005c832 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:54.824407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-04b4cfc4-9218-401d-97f4-6740a005c832 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:54.826698 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-19fb709e-43fb-4a13-b69a-d01c09ba173b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:54.844845 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-04b4cfc4-9218-401d-97f4-6740a005c832 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:54.850777 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-04b4cfc4-9218-401d-97f4-6740a005c832 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:54.852498 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-04b4cfc4-9218-401d-97f4-6740a005c832 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:54.856877 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-04b4cfc4-9218-401d-97f4-6740a005c832 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:54.858002 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-04b4cfc4-9218-401d-97f4-6740a005c832 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:54.858975 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-04b4cfc4-9218-401d-97f4-6740a005c832 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:54.859686 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-19fb709e-43fb-4a13-b69a-d01c09ba173b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:54.860539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-19fb709e-43fb-4a13-b69a-d01c09ba173b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:54.861299 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-19fb709e-43fb-4a13-b69a-d01c09ba173b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:54.866155 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-19fb709e-43fb-4a13-b69a-d01c09ba173b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:54.867345 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-19fb709e-43fb-4a13-b69a-d01c09ba173b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:54.873014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-19fb709e-43fb-4a13-b69a-d01c09ba173b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:54.914213 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:55.159734 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-19fb709e-43fb-4a13-b69a-d01c09ba173b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:55.163278 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-04b4cfc4-9218-401d-97f4-6740a005c832 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:55.172940 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-04b4cfc4-9218-401d-97f4-6740a005c832 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:55.176859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-19fb709e-43fb-4a13-b69a-d01c09ba173b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.375609 Sep 01 14:03:55.177022 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-04b4cfc4-9218-401d-97f4-6740a005c832 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:55.177179 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 206/408] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:54 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:55.177931 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-04b4cfc4-9218-401d-97f4-6740a005c832 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.383753 Sep 01 14:03:55.177931 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 203/409] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:54 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:55.594134 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9b6000eb-fac9-48f1-8743-cf36f7076144 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:55.595082 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9b6000eb-fac9-48f1-8743-cf36f7076144 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:55.603273 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b6000eb-fac9-48f1-8743-cf36f7076144 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:55.603827 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b6000eb-fac9-48f1-8743-cf36f7076144 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:55.604403 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b6000eb-fac9-48f1-8743-cf36f7076144 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:55.605288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b6000eb-fac9-48f1-8743-cf36f7076144 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:55.605825 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b6000eb-fac9-48f1-8743-cf36f7076144 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:55.606468 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b6000eb-fac9-48f1-8743-cf36f7076144 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:55.617635 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ecde8e9e-03e5-4dd0-8679-f689f0c9c82e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:55.618542 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ecde8e9e-03e5-4dd0-8679-f689f0c9c82e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:55.625123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecde8e9e-03e5-4dd0-8679-f689f0c9c82e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:55.625926 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecde8e9e-03e5-4dd0-8679-f689f0c9c82e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:55.626357 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecde8e9e-03e5-4dd0-8679-f689f0c9c82e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:55.627278 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecde8e9e-03e5-4dd0-8679-f689f0c9c82e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:55.627727 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecde8e9e-03e5-4dd0-8679-f689f0c9c82e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:55.628395 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecde8e9e-03e5-4dd0-8679-f689f0c9c82e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:56.232957 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9b6000eb-fac9-48f1-8743-cf36f7076144 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:56.250159 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9b6000eb-fac9-48f1-8743-cf36f7076144 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.660752 Sep 01 14:03:56.251623 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 207/410] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:55 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:56.253763 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ecde8e9e-03e5-4dd0-8679-f689f0c9c82e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:56.261150 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e21281bb-d679-4a29-b51c-175114ec704a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:56.263114 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e21281bb-d679-4a29-b51c-175114ec704a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:56.263898 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ecde8e9e-03e5-4dd0-8679-f689f0c9c82e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.651016 Sep 01 14:03:56.278381 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 204/411] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:55 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:56.282537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e21281bb-d679-4a29-b51c-175114ec704a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:56.283161 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c2734197-2f43-4888-9397-1edb0ae1ae6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:56.283804 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e21281bb-d679-4a29-b51c-175114ec704a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:56.283981 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c2734197-2f43-4888-9397-1edb0ae1ae6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:56.284818 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e21281bb-d679-4a29-b51c-175114ec704a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:56.286335 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e21281bb-d679-4a29-b51c-175114ec704a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:56.287826 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e21281bb-d679-4a29-b51c-175114ec704a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:56.294620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e21281bb-d679-4a29-b51c-175114ec704a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:56.294776 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2734197-2f43-4888-9397-1edb0ae1ae6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:56.295069 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2734197-2f43-4888-9397-1edb0ae1ae6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:56.295510 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2734197-2f43-4888-9397-1edb0ae1ae6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:56.296230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2734197-2f43-4888-9397-1edb0ae1ae6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:56.296757 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2734197-2f43-4888-9397-1edb0ae1ae6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:56.297176 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2734197-2f43-4888-9397-1edb0ae1ae6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:56.547868 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c2734197-2f43-4888-9397-1edb0ae1ae6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:56.557152 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e21281bb-d679-4a29-b51c-175114ec704a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:56.557763 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c2734197-2f43-4888-9397-1edb0ae1ae6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:56.559342 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c2734197-2f43-4888-9397-1edb0ae1ae6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:56.560634 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c2734197-2f43-4888-9397-1edb0ae1ae6b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.281478 Sep 01 14:03:56.561828 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 205/412] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:56 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:03:56.567017 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e21281bb-d679-4a29-b51c-175114ec704a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.313531 Sep 01 14:03:56.567297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 208/413] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:56 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:57.275922 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-987c74c9-ac57-4bca-84e9-162f15699776 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:57.276637 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-987c74c9-ac57-4bca-84e9-162f15699776 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:57.285963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-6466db76-19c2-460c-bd32-685aa4b74b48 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:57.287576 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-987c74c9-ac57-4bca-84e9-162f15699776 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:57.287910 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-6466db76-19c2-460c-bd32-685aa4b74b48 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:57.288082 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-987c74c9-ac57-4bca-84e9-162f15699776 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:57.288540 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-987c74c9-ac57-4bca-84e9-162f15699776 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:57.289342 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-987c74c9-ac57-4bca-84e9-162f15699776 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:57.289834 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-987c74c9-ac57-4bca-84e9-162f15699776 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:57.290318 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-987c74c9-ac57-4bca-84e9-162f15699776 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:57.295205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6466db76-19c2-460c-bd32-685aa4b74b48 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:57.295695 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6466db76-19c2-460c-bd32-685aa4b74b48 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:57.296127 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6466db76-19c2-460c-bd32-685aa4b74b48 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:57.296902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6466db76-19c2-460c-bd32-685aa4b74b48 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:57.297359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6466db76-19c2-460c-bd32-685aa4b74b48 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:57.297807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6466db76-19c2-460c-bd32-685aa4b74b48 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:57.506443 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-6466db76-19c2-460c-bd32-685aa4b74b48 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:57.513744 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-987c74c9-ac57-4bca-84e9-162f15699776 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:57.514892 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-6466db76-19c2-460c-bd32-685aa4b74b48 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.233065 Sep 01 14:03:57.515463 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 209/414] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:57 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:57.522257 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-987c74c9-ac57-4bca-84e9-162f15699776 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.250995 Sep 01 14:03:57.522985 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 206/415] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:57 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:57.589049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0e68318b-24a2-4fac-9844-f623379269af tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:57.589647 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0e68318b-24a2-4fac-9844-f623379269af tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:57.592000 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f3439cef-b2a4-4eee-b971-803726f9e107 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:57.592597 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f3439cef-b2a4-4eee-b971-803726f9e107 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:57.596231 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0e68318b-24a2-4fac-9844-f623379269af tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:57.596748 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0e68318b-24a2-4fac-9844-f623379269af tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:57.597182 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0e68318b-24a2-4fac-9844-f623379269af tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:57.597902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0e68318b-24a2-4fac-9844-f623379269af tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:57.598381 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0e68318b-24a2-4fac-9844-f623379269af tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:57.598487 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f3439cef-b2a4-4eee-b971-803726f9e107 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:57.598799 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0e68318b-24a2-4fac-9844-f623379269af tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:57.598969 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f3439cef-b2a4-4eee-b971-803726f9e107 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:57.599961 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f3439cef-b2a4-4eee-b971-803726f9e107 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:57.600694 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f3439cef-b2a4-4eee-b971-803726f9e107 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:57.601144 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f3439cef-b2a4-4eee-b971-803726f9e107 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:57.601569 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f3439cef-b2a4-4eee-b971-803726f9e107 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:57.804498 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0e68318b-24a2-4fac-9844-f623379269af tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:57.810656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f3439cef-b2a4-4eee-b971-803726f9e107 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:57.812902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0e68318b-24a2-4fac-9844-f623379269af tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.228009 Sep 01 14:03:57.813565 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 210/416] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:57 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:57.819904 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f3439cef-b2a4-4eee-b971-803726f9e107 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:57.821363 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f3439cef-b2a4-4eee-b971-803726f9e107 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:57.822561 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f3439cef-b2a4-4eee-b971-803726f9e107 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.234499 Sep 01 14:03:57.823130 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 207/417] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:57 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:58.538648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-946654f3-8947-44b8-9b36-3118c6b9122a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:58.539293 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-946654f3-8947-44b8-9b36-3118c6b9122a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:58.542294 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-51ff070a-93b3-47b4-885f-6bdb23eaf3eb tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:58.542899 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-51ff070a-93b3-47b4-885f-6bdb23eaf3eb tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:58.546097 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-946654f3-8947-44b8-9b36-3118c6b9122a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:58.546594 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-946654f3-8947-44b8-9b36-3118c6b9122a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:58.547032 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-946654f3-8947-44b8-9b36-3118c6b9122a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:58.547789 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-946654f3-8947-44b8-9b36-3118c6b9122a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:58.548303 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-946654f3-8947-44b8-9b36-3118c6b9122a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:58.548736 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-946654f3-8947-44b8-9b36-3118c6b9122a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:58.549697 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-51ff070a-93b3-47b4-885f-6bdb23eaf3eb tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:58.550209 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-51ff070a-93b3-47b4-885f-6bdb23eaf3eb tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:58.550641 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-51ff070a-93b3-47b4-885f-6bdb23eaf3eb tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:58.551361 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-51ff070a-93b3-47b4-885f-6bdb23eaf3eb tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:58.551813 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-51ff070a-93b3-47b4-885f-6bdb23eaf3eb tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:58.552238 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-51ff070a-93b3-47b4-885f-6bdb23eaf3eb tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:58.749627 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-946654f3-8947-44b8-9b36-3118c6b9122a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:58.757546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-51ff070a-93b3-47b4-885f-6bdb23eaf3eb tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:58.757990 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-946654f3-8947-44b8-9b36-3118c6b9122a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.223138 Sep 01 14:03:58.758759 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 211/418] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:58 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:58.768050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-51ff070a-93b3-47b4-885f-6bdb23eaf3eb tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.229373 Sep 01 14:03:58.768660 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 208/419] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:58 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:03:58.844443 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-fac9b6de-b407-4df9-af85-38be5614ea7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:58.845061 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-fac9b6de-b407-4df9-af85-38be5614ea7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:58.845406 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4b07328d-d6cc-4b74-87cc-b9f41bfd3b21 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:58.846045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4b07328d-d6cc-4b74-87cc-b9f41bfd3b21 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:58.851450 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fac9b6de-b407-4df9-af85-38be5614ea7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:58.851950 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fac9b6de-b407-4df9-af85-38be5614ea7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:58.852363 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b07328d-d6cc-4b74-87cc-b9f41bfd3b21 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:58.852492 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fac9b6de-b407-4df9-af85-38be5614ea7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:58.852853 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b07328d-d6cc-4b74-87cc-b9f41bfd3b21 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:58.853085 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fac9b6de-b407-4df9-af85-38be5614ea7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:58.853286 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b07328d-d6cc-4b74-87cc-b9f41bfd3b21 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:58.853539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fac9b6de-b407-4df9-af85-38be5614ea7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:58.853999 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fac9b6de-b407-4df9-af85-38be5614ea7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:58.854107 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b07328d-d6cc-4b74-87cc-b9f41bfd3b21 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:58.854457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b07328d-d6cc-4b74-87cc-b9f41bfd3b21 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:58.854879 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b07328d-d6cc-4b74-87cc-b9f41bfd3b21 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:59.118812 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fac9b6de-b407-4df9-af85-38be5614ea7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:59.127240 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-fac9b6de-b407-4df9-af85-38be5614ea7c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.286680 Sep 01 14:03:59.127822 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 212/420] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:58 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:03:59.128024 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4b07328d-d6cc-4b74-87cc-b9f41bfd3b21 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:59.132040 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:03:59.138996 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4b07328d-d6cc-4b74-87cc-b9f41bfd3b21 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:59.140638 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4b07328d-d6cc-4b74-87cc-b9f41bfd3b21 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:03:59.142057 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4b07328d-d6cc-4b74-87cc-b9f41bfd3b21 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.300227 Sep 01 14:03:59.142762 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 209/421] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:03:58 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:03:59.778552 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-06084570-2976-46f8-b90f-140ed1b6d176 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:59.779233 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-06084570-2976-46f8-b90f-140ed1b6d176 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:59.785825 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06084570-2976-46f8-b90f-140ed1b6d176 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:59.786320 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06084570-2976-46f8-b90f-140ed1b6d176 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:59.786763 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06084570-2976-46f8-b90f-140ed1b6d176 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:59.787465 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06084570-2976-46f8-b90f-140ed1b6d176 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:59.789899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06084570-2976-46f8-b90f-140ed1b6d176 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:59.789899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06084570-2976-46f8-b90f-140ed1b6d176 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:59.795848 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c2672eb0-0e61-4d72-b864-6e5c7897cd32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:03:59.796475 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c2672eb0-0e61-4d72-b864-6e5c7897cd32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:03:59.807706 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2672eb0-0e61-4d72-b864-6e5c7897cd32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:59.807706 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2672eb0-0e61-4d72-b864-6e5c7897cd32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:59.807706 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2672eb0-0e61-4d72-b864-6e5c7897cd32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:03:59.807706 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2672eb0-0e61-4d72-b864-6e5c7897cd32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:03:59.808144 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2672eb0-0e61-4d72-b864-6e5c7897cd32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:03:59.808144 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2672eb0-0e61-4d72-b864-6e5c7897cd32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:00.069114 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-06084570-2976-46f8-b90f-140ed1b6d176 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:00.073681 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c2672eb0-0e61-4d72-b864-6e5c7897cd32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:00.079254 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-06084570-2976-46f8-b90f-140ed1b6d176 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.303188 Sep 01 14:04:00.079254 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 213/422] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:59 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:00.082037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c2672eb0-0e61-4d72-b864-6e5c7897cd32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1314 microversion: 2.1 time: 0.290494 Sep 01 14:04:00.082689 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 210/423] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:03:59 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:00.148317 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1330c978-4ec2-47db-9fe6-be248ec079f5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:00.148968 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1330c978-4ec2-47db-9fe6-be248ec079f5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:00.155404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1330c978-4ec2-47db-9fe6-be248ec079f5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:00.156176 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1330c978-4ec2-47db-9fe6-be248ec079f5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:00.156385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1330c978-4ec2-47db-9fe6-be248ec079f5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:00.157089 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1330c978-4ec2-47db-9fe6-be248ec079f5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:00.157609 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1330c978-4ec2-47db-9fe6-be248ec079f5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:00.158070 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1330c978-4ec2-47db-9fe6-be248ec079f5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:00.174965 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b78d4632-5637-4448-a217-b80100c7654d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:00.176629 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b78d4632-5637-4448-a217-b80100c7654d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:00.194861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b78d4632-5637-4448-a217-b80100c7654d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:00.194861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b78d4632-5637-4448-a217-b80100c7654d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:00.194861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b78d4632-5637-4448-a217-b80100c7654d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:00.194861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b78d4632-5637-4448-a217-b80100c7654d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:00.195208 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b78d4632-5637-4448-a217-b80100c7654d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:00.195208 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b78d4632-5637-4448-a217-b80100c7654d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:00.370227 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1330c978-4ec2-47db-9fe6-be248ec079f5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:00.375306 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b78d4632-5637-4448-a217-b80100c7654d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:00.378650 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1330c978-4ec2-47db-9fe6-be248ec079f5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.234220 Sep 01 14:04:00.382578 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 214/424] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:00 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:00.385607 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b78d4632-5637-4448-a217-b80100c7654d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:00.387112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b78d4632-5637-4448-a217-b80100c7654d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:00.388386 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b78d4632-5637-4448-a217-b80100c7654d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.217346 Sep 01 14:04:00.388976 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 211/425] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:00 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:04:01.099876 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e92202f2-57b5-4c33-886a-3b1510c7c71b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:01.101066 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e92202f2-57b5-4c33-886a-3b1510c7c71b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:01.110263 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c614b0f7-3674-4e7a-82d8-60fc366d2904 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:01.112455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c614b0f7-3674-4e7a-82d8-60fc366d2904 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:01.113994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e92202f2-57b5-4c33-886a-3b1510c7c71b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:01.114492 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e92202f2-57b5-4c33-886a-3b1510c7c71b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:01.115429 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e92202f2-57b5-4c33-886a-3b1510c7c71b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:01.116138 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e92202f2-57b5-4c33-886a-3b1510c7c71b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:01.120225 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e92202f2-57b5-4c33-886a-3b1510c7c71b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:01.121462 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e92202f2-57b5-4c33-886a-3b1510c7c71b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:01.129489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c614b0f7-3674-4e7a-82d8-60fc366d2904 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:01.130027 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c614b0f7-3674-4e7a-82d8-60fc366d2904 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:01.131082 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c614b0f7-3674-4e7a-82d8-60fc366d2904 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:01.131792 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c614b0f7-3674-4e7a-82d8-60fc366d2904 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:01.142312 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c614b0f7-3674-4e7a-82d8-60fc366d2904 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:01.142797 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c614b0f7-3674-4e7a-82d8-60fc366d2904 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:01.517898 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e92202f2-57b5-4c33-886a-3b1510c7c71b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:01.525461 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c614b0f7-3674-4e7a-82d8-60fc366d2904 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:01.537850 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c614b0f7-3674-4e7a-82d8-60fc366d2904 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1498 microversion: 2.1 time: 0.431266 Sep 01 14:04:01.538521 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 212/426] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:01 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1498 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:01.540372 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e92202f2-57b5-4c33-886a-3b1510c7c71b tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.444703 Sep 01 14:04:01.558006 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 215/427] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:01 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:01.575090 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-2076093c-400e-47e2-abf0-bc31ec2113c5 req-dc3f25a5-0c58-45e4-933a-3dc8fc8896bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d699cea-9245-405e-87bb-0c9e6af9391b", "name": "network-vif-plugged", "status": "completed", "tag": "095e75e8-b9ca-4c49-8292-9f9586ad794f"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:01.582407 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2b1de76b-1bd3-4677-b95d-d78520b65652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:01.583073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2b1de76b-1bd3-4677-b95d-d78520b65652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:01.586980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-2076093c-400e-47e2-abf0-bc31ec2113c5 req-dc3f25a5-0c58-45e4-933a-3dc8fc8896bd service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:01.587850 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-2076093c-400e-47e2-abf0-bc31ec2113c5 req-dc3f25a5-0c58-45e4-933a-3dc8fc8896bd service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:01.588786 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-2076093c-400e-47e2-abf0-bc31ec2113c5 req-dc3f25a5-0c58-45e4-933a-3dc8fc8896bd service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:01.602534 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b1de76b-1bd3-4677-b95d-d78520b65652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:01.602534 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b1de76b-1bd3-4677-b95d-d78520b65652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:01.602534 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b1de76b-1bd3-4677-b95d-d78520b65652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:01.602534 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b1de76b-1bd3-4677-b95d-d78520b65652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:01.603217 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b1de76b-1bd3-4677-b95d-d78520b65652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:01.603217 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b1de76b-1bd3-4677-b95d-d78520b65652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:01.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-2076093c-400e-47e2-abf0-bc31ec2113c5 req-dc3f25a5-0c58-45e4-933a-3dc8fc8896bd service nova] Creating event network-vif-plugged:095e75e8-b9ca-4c49-8292-9f9586ad794f for instance 4d699cea-9245-405e-87bb-0c9e6af9391b on hv-cinder-85221 Sep 01 14:04:01.616627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-2076093c-400e-47e2-abf0-bc31ec2113c5 req-dc3f25a5-0c58-45e4-933a-3dc8fc8896bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074904 Sep 01 14:04:01.617325 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 213/428] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:01.624223 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8a5ffe96-004b-4c7f-bd11-550c45d89bbf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:01.626893 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8a5ffe96-004b-4c7f-bd11-550c45d89bbf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:01.632818 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8a5ffe96-004b-4c7f-bd11-550c45d89bbf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:01.633457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8a5ffe96-004b-4c7f-bd11-550c45d89bbf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:01.633964 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8a5ffe96-004b-4c7f-bd11-550c45d89bbf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:01.634758 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8a5ffe96-004b-4c7f-bd11-550c45d89bbf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:01.635212 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8a5ffe96-004b-4c7f-bd11-550c45d89bbf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:01.635640 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8a5ffe96-004b-4c7f-bd11-550c45d89bbf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:01.786193 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2b1de76b-1bd3-4677-b95d-d78520b65652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:01.795013 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2b1de76b-1bd3-4677-b95d-d78520b65652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.235863 Sep 01 14:04:01.795600 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 216/429] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:01 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:01.811559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8a5ffe96-004b-4c7f-bd11-550c45d89bbf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:01.820391 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8a5ffe96-004b-4c7f-bd11-550c45d89bbf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:01.832566 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8a5ffe96-004b-4c7f-bd11-550c45d89bbf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:01.832566 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8a5ffe96-004b-4c7f-bd11-550c45d89bbf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.204487 Sep 01 14:04:01.832566 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 214/430] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:01 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:02.564642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7f1301c1-388d-4b28-abc8-1b59c3e49f7d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:02.565251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7f1301c1-388d-4b28-abc8-1b59c3e49f7d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:02.572549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7f1301c1-388d-4b28-abc8-1b59c3e49f7d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:02.573038 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7f1301c1-388d-4b28-abc8-1b59c3e49f7d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:02.573503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7f1301c1-388d-4b28-abc8-1b59c3e49f7d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:02.574239 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7f1301c1-388d-4b28-abc8-1b59c3e49f7d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:02.574693 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7f1301c1-388d-4b28-abc8-1b59c3e49f7d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:02.575115 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7f1301c1-388d-4b28-abc8-1b59c3e49f7d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:02.721824 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7f1301c1-388d-4b28-abc8-1b59c3e49f7d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:02.733507 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7f1301c1-388d-4b28-abc8-1b59c3e49f7d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.172434 Sep 01 14:04:02.740786 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 217/431] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:02 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:02.800529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8e024b85-8b1d-40fa-b7f7-32557db8cab5 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:02.801130 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8e024b85-8b1d-40fa-b7f7-32557db8cab5 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:02.808842 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e024b85-8b1d-40fa-b7f7-32557db8cab5 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:02.809325 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e024b85-8b1d-40fa-b7f7-32557db8cab5 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:02.809762 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e024b85-8b1d-40fa-b7f7-32557db8cab5 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:02.810498 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e024b85-8b1d-40fa-b7f7-32557db8cab5 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:02.811024 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e024b85-8b1d-40fa-b7f7-32557db8cab5 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:02.811850 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e024b85-8b1d-40fa-b7f7-32557db8cab5 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:02.817171 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-292eed40-c1f5-423c-8fb5-8f5900aee632 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:02.817815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-292eed40-c1f5-423c-8fb5-8f5900aee632 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:02.823815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-292eed40-c1f5-423c-8fb5-8f5900aee632 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:02.828447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-292eed40-c1f5-423c-8fb5-8f5900aee632 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:02.828447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-292eed40-c1f5-423c-8fb5-8f5900aee632 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:02.828447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-292eed40-c1f5-423c-8fb5-8f5900aee632 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:02.828447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-292eed40-c1f5-423c-8fb5-8f5900aee632 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:02.829093 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-292eed40-c1f5-423c-8fb5-8f5900aee632 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:02.839123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8e024b85-8b1d-40fa-b7f7-32557db8cab5 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Going to try to terminate instance {{(pid=127812) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:04:02.973125 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-292eed40-c1f5-423c-8fb5-8f5900aee632 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:02.982799 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-292eed40-c1f5-423c-8fb5-8f5900aee632 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.169852 Sep 01 14:04:02.983388 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 218/432] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:02 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:02.988305 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-401ae596-fc69-44e5-986f-4da6da38efc5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:02.988906 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-401ae596-fc69-44e5-986f-4da6da38efc5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:02.996229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-401ae596-fc69-44e5-986f-4da6da38efc5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:03.000274 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-401ae596-fc69-44e5-986f-4da6da38efc5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:03.000274 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-401ae596-fc69-44e5-986f-4da6da38efc5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:03.000274 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-401ae596-fc69-44e5-986f-4da6da38efc5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:03.000274 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-401ae596-fc69-44e5-986f-4da6da38efc5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:03.000687 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-401ae596-fc69-44e5-986f-4da6da38efc5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:03.138127 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-401ae596-fc69-44e5-986f-4da6da38efc5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:03.146602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-401ae596-fc69-44e5-986f-4da6da38efc5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:03.148095 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-401ae596-fc69-44e5-986f-4da6da38efc5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:03.149273 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-401ae596-fc69-44e5-986f-4da6da38efc5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.164776 Sep 01 14:04:03.149869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 219/433] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:02 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:03.282387 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8e024b85-8b1d-40fa-b7f7-32557db8cab5 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 204 len: 0 microversion: 2.1 time: 0.485391 Sep 01 14:04:03.282998 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 215/434] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:04:02 2022] DELETE /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:04:03.292795 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ad1fca0e-54ab-488e-ba9d-80f56e655f78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:03.293423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ad1fca0e-54ab-488e-ba9d-80f56e655f78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:03.300621 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ad1fca0e-54ab-488e-ba9d-80f56e655f78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:03.301166 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ad1fca0e-54ab-488e-ba9d-80f56e655f78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:03.301718 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ad1fca0e-54ab-488e-ba9d-80f56e655f78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:03.302591 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ad1fca0e-54ab-488e-ba9d-80f56e655f78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:03.303091 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ad1fca0e-54ab-488e-ba9d-80f56e655f78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:03.303619 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ad1fca0e-54ab-488e-ba9d-80f56e655f78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:03.454739 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ad1fca0e-54ab-488e-ba9d-80f56e655f78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:03.463733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ad1fca0e-54ab-488e-ba9d-80f56e655f78 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1504 microversion: 2.1 time: 0.175310 Sep 01 14:04:03.468533 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 220/435] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:03 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:03.761445 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9d706988-7ec9-435d-8bd9-8e71ea2593ed tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:03.762702 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9d706988-7ec9-435d-8bd9-8e71ea2593ed tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:03.774329 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9d706988-7ec9-435d-8bd9-8e71ea2593ed tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:03.775188 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9d706988-7ec9-435d-8bd9-8e71ea2593ed tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:03.775945 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9d706988-7ec9-435d-8bd9-8e71ea2593ed tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:03.777180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9d706988-7ec9-435d-8bd9-8e71ea2593ed tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:03.778007 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9d706988-7ec9-435d-8bd9-8e71ea2593ed tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:03.778731 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9d706988-7ec9-435d-8bd9-8e71ea2593ed tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:03.943920 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9d706988-7ec9-435d-8bd9-8e71ea2593ed tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:03.953408 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9d706988-7ec9-435d-8bd9-8e71ea2593ed tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1357 microversion: 2.1 time: 0.200488 Sep 01 14:04:03.954357 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 216/436] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:03 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1357 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:04.005164 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-fc178dea-0a36-44e3-8532-7c54956af9dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:04.007036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-fc178dea-0a36-44e3-8532-7c54956af9dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:04.014247 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fc178dea-0a36-44e3-8532-7c54956af9dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.014747 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fc178dea-0a36-44e3-8532-7c54956af9dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.015187 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fc178dea-0a36-44e3-8532-7c54956af9dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.015987 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fc178dea-0a36-44e3-8532-7c54956af9dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.016449 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fc178dea-0a36-44e3-8532-7c54956af9dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.016878 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fc178dea-0a36-44e3-8532-7c54956af9dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.161539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fc178dea-0a36-44e3-8532-7c54956af9dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:04.170218 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-fc178dea-0a36-44e3-8532-7c54956af9dc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1501 microversion: 2.1 time: 0.169052 Sep 01 14:04:04.171084 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 221/437] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:03 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1501 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:04.178492 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-536b0fba-f9b4-4ea2-b092-f095788960ff tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:04.179501 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-536b0fba-f9b4-4ea2-b092-f095788960ff tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:04.187331 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-536b0fba-f9b4-4ea2-b092-f095788960ff tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.187830 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-536b0fba-f9b4-4ea2-b092-f095788960ff tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.188260 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-536b0fba-f9b4-4ea2-b092-f095788960ff tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.194770 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-536b0fba-f9b4-4ea2-b092-f095788960ff tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.194770 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-536b0fba-f9b4-4ea2-b092-f095788960ff tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.194770 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-536b0fba-f9b4-4ea2-b092-f095788960ff tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.203253 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-81d63993-0eee-4ad6-9d94-c1e1ec0c7f77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a5717d5-981d-48dc-9fb5-163bfb53f03d"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:04.205730 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-81d63993-0eee-4ad6-9d94-c1e1ec0c7f77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:04.212612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-81d63993-0eee-4ad6-9d94-c1e1ec0c7f77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.213332 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-81d63993-0eee-4ad6-9d94-c1e1ec0c7f77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.213996 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-81d63993-0eee-4ad6-9d94-c1e1ec0c7f77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.215155 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-81d63993-0eee-4ad6-9d94-c1e1ec0c7f77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.215733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-81d63993-0eee-4ad6-9d94-c1e1ec0c7f77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.216277 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-81d63993-0eee-4ad6-9d94-c1e1ec0c7f77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-81d63993-0eee-4ad6-9d94-c1e1ec0c7f77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] HTTP exception thrown: Cannot 'attach_volume' instance b03c776a-6615-43a6-88bd-58efe9736c7f while it is in vm_state rescued Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-81d63993-0eee-4ad6-9d94-c1e1ec0c7f77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Request method failure captured: Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: POST /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f/os-volume_attachments HTTP/1.1 Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 74 Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELtodHK0hlU0ssq5VsVzMh6Isxe-uCStXQYmXx3WC5v-cWde1ZtUEz4tBUd99Izqseob2wB5HoMDtngWz9-8nQFIx5OnaExar3GImRdIpuyNt3odGrByyBSZ4Yaf1qZx3OBIwh6RmJIDNKvWbLt58dvpxlaGOkEb_1yXcgptrN7a0EY Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: dce10589b8b240e6829f2e158415a1b8 Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:04:04.257512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:04:04.259310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dce10589b8b240e6829f2e158415a1b8"}]}] Sep 01 14:04:04.259310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:04:04.259310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: dce10589b8b240e6829f2e158415a1b8 Sep 01 14:04:04.259310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:04:04.259310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-ServerRescueNegativeTestJSON-1978503690-project Sep 01 14:04:04.259310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:04:04.259310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:04:04.259310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 65c88d8b86544ab5825adbadb26b1e2e Sep 01 14:04:04.259310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1978503690-project Sep 01 14:04:04.259310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Sep 01 14:04:04.259310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {"volumeAttachment": {"volumeId": "9a5717d5-981d-48dc-9fb5-163bfb53f03d"}} Sep 01 14:04:04.259310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Cannot 'attach_volume' instance b03c776a-6615-43a6-88bd-58efe9736c7f while it is in vm_state rescued Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'server_id': 'b03c776a-6615-43a6-88bd-58efe9736c7f', 'body': {'volumeAttachment': {'volumeId': '9a5717d5-981d-48dc-9fb5-163bfb53f03d'}}} Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b03c776a-6615-43a6-88bd-58efe9736c7f in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:04:04.260241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b03c776a-6615-43a6-88bd-58efe9736c7f while it is in vm_state rescued Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:04:04.261648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:04:04.264612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:04:04.264612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:04:04.264612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b03c776a-6615-43a6-88bd-58efe9736c7f while it is in vm_state rescued Sep 01 14:04:04.264612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:04.264612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-81d63993-0eee-4ad6-9d94-c1e1ec0c7f77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Returning 409 to user: Cannot 'attach_volume' instance b03c776a-6615-43a6-88bd-58efe9736c7f while it is in vm_state rescued {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:04:04.264612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-81d63993-0eee-4ad6-9d94-c1e1ec0c7f77 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "POST /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056480 Sep 01 14:04:04.264612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 222/438] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:04:04 2022] POST /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 01 14:04:04.266457 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c4287900-59af-4fd2-b244-f5238a9d3776 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:04.267006 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c4287900-59af-4fd2-b244-f5238a9d3776 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:04.277885 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c4287900-59af-4fd2-b244-f5238a9d3776 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.277885 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c4287900-59af-4fd2-b244-f5238a9d3776 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.277885 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c4287900-59af-4fd2-b244-f5238a9d3776 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.277885 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c4287900-59af-4fd2-b244-f5238a9d3776 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.278552 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c4287900-59af-4fd2-b244-f5238a9d3776 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.278552 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c4287900-59af-4fd2-b244-f5238a9d3776 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.296131 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:04.374877 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-536b0fba-f9b4-4ea2-b092-f095788960ff tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:04.391723 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-536b0fba-f9b4-4ea2-b092-f095788960ff tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:04.391723 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-536b0fba-f9b4-4ea2-b092-f095788960ff tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:04.391723 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-536b0fba-f9b4-4ea2-b092-f095788960ff tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.217109 Sep 01 14:04:04.392196 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 217/439] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:04 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:04:04.486476 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b50dd33e-942f-46bb-99fb-f7ceb43ebc14 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:04.487389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b50dd33e-942f-46bb-99fb-f7ceb43ebc14 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:04.495027 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b50dd33e-942f-46bb-99fb-f7ceb43ebc14 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.495536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b50dd33e-942f-46bb-99fb-f7ceb43ebc14 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.495994 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b50dd33e-942f-46bb-99fb-f7ceb43ebc14 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.496745 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b50dd33e-942f-46bb-99fb-f7ceb43ebc14 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.497217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b50dd33e-942f-46bb-99fb-f7ceb43ebc14 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.497671 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b50dd33e-942f-46bb-99fb-f7ceb43ebc14 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.586781 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c4287900-59af-4fd2-b244-f5238a9d3776 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "POST /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f/action" status: 202 len: 0 microversion: 2.1 time: 0.324088 Sep 01 14:04:04.589871 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 223/440] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:04:04 2022] POST /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:04:04.599827 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-09051c6e-1961-4192-a04a-8857619555e3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:04.601138 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-09051c6e-1961-4192-a04a-8857619555e3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:04.611472 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-09051c6e-1961-4192-a04a-8857619555e3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.612485 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-09051c6e-1961-4192-a04a-8857619555e3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.613832 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-09051c6e-1961-4192-a04a-8857619555e3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.615293 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-09051c6e-1961-4192-a04a-8857619555e3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.616066 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-09051c6e-1961-4192-a04a-8857619555e3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.616689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-09051c6e-1961-4192-a04a-8857619555e3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.675685 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b50dd33e-942f-46bb-99fb-f7ceb43ebc14 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:04.684630 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b50dd33e-942f-46bb-99fb-f7ceb43ebc14 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1504 microversion: 2.1 time: 0.203114 Sep 01 14:04:04.697834 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 218/441] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:04 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:04.809276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-09051c6e-1961-4192-a04a-8857619555e3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:04.818828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-09051c6e-1961-4192-a04a-8857619555e3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.225729 Sep 01 14:04:04.830242 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 224/442] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:04 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:04.987522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-cc2bcaf0-1e79-42ea-8416-dd8674b27c09 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:04.988228 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-cc2bcaf0-1e79-42ea-8416-dd8674b27c09 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:04.995125 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc2bcaf0-1e79-42ea-8416-dd8674b27c09 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.995608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc2bcaf0-1e79-42ea-8416-dd8674b27c09 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.996041 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc2bcaf0-1e79-42ea-8416-dd8674b27c09 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:04.996837 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc2bcaf0-1e79-42ea-8416-dd8674b27c09 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:04.997283 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc2bcaf0-1e79-42ea-8416-dd8674b27c09 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:04.997704 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cc2bcaf0-1e79-42ea-8416-dd8674b27c09 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.140774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-cc2bcaf0-1e79-42ea-8416-dd8674b27c09 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:05.151179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-cc2bcaf0-1e79-42ea-8416-dd8674b27c09 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1548 microversion: 2.1 time: 0.167716 Sep 01 14:04:05.151964 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 219/443] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:04 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:05.172927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-61c88ea7-3de3-4b44-a3ff-bc8a7bda613d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:05.173543 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-61c88ea7-3de3-4b44-a3ff-bc8a7bda613d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:05.180820 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-61c88ea7-3de3-4b44-a3ff-bc8a7bda613d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.181317 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-61c88ea7-3de3-4b44-a3ff-bc8a7bda613d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.182217 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-61c88ea7-3de3-4b44-a3ff-bc8a7bda613d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.182494 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-61c88ea7-3de3-4b44-a3ff-bc8a7bda613d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.182949 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-61c88ea7-3de3-4b44-a3ff-bc8a7bda613d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.183377 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-61c88ea7-3de3-4b44-a3ff-bc8a7bda613d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.340445 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-61c88ea7-3de3-4b44-a3ff-bc8a7bda613d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:05.354496 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-61c88ea7-3de3-4b44-a3ff-bc8a7bda613d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1548 microversion: 2.1 time: 0.185176 Sep 01 14:04:05.355499 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 225/444] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:05 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1548 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:05.386599 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5fc5b6df-12c7-4cbd-b9a7-133773e1eae8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:05.392138 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5fc5b6df-12c7-4cbd-b9a7-133773e1eae8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:05.392931 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5fc5b6df-12c7-4cbd-b9a7-133773e1eae8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Searching by: {'deleted': False, 'project_id': 'a9e92afcc6744da393978638b5b986a5'} {{(pid=127812) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 14:04:05.400935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5fc5b6df-12c7-4cbd-b9a7-133773e1eae8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.401182 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5fc5b6df-12c7-4cbd-b9a7-133773e1eae8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.401616 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5fc5b6df-12c7-4cbd-b9a7-133773e1eae8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.402554 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5fc5b6df-12c7-4cbd-b9a7-133773e1eae8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.403228 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5fc5b6df-12c7-4cbd-b9a7-133773e1eae8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.403678 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5fc5b6df-12c7-4cbd-b9a7-133773e1eae8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.418190 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1d368122-e54d-4a64-8205-6e81b87b14f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:05.419234 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1d368122-e54d-4a64-8205-6e81b87b14f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:05.423860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:05.430274 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d368122-e54d-4a64-8205-6e81b87b14f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.431095 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d368122-e54d-4a64-8205-6e81b87b14f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.431832 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d368122-e54d-4a64-8205-6e81b87b14f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.432991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d368122-e54d-4a64-8205-6e81b87b14f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.433754 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d368122-e54d-4a64-8205-6e81b87b14f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.434488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d368122-e54d-4a64-8205-6e81b87b14f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.503366 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.multi_cell_list [None req-5fc5b6df-12c7-4cbd-b9a7-133773e1eae8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127812) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 14:04:05.600199 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1d368122-e54d-4a64-8205-6e81b87b14f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:05.606202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5fc5b6df-12c7-4cbd-b9a7-133773e1eae8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.223456 Sep 01 14:04:05.607004 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 220/445] 10.222.0.61 () {58 vars in 1125 bytes} [Thu Sep 1 14:04:05 2022] GET /compute/v2.1/servers => generated 342 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:05.609412 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1d368122-e54d-4a64-8205-6e81b87b14f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:05.611072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1d368122-e54d-4a64-8205-6e81b87b14f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:05.612237 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1d368122-e54d-4a64-8205-6e81b87b14f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.201088 Sep 01 14:04:05.612808 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 226/446] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:05 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:04:05.631656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d127ee88-319b-4979-b6b0-d79ddf5575ea tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:05.632370 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d127ee88-319b-4979-b6b0-d79ddf5575ea tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:05.638724 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d127ee88-319b-4979-b6b0-d79ddf5575ea tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.639221 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d127ee88-319b-4979-b6b0-d79ddf5575ea tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.639644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d127ee88-319b-4979-b6b0-d79ddf5575ea tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.640390 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d127ee88-319b-4979-b6b0-d79ddf5575ea tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.640835 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d127ee88-319b-4979-b6b0-d79ddf5575ea tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.641256 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d127ee88-319b-4979-b6b0-d79ddf5575ea tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.711208 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ce576b3c-c5ba-4965-bae3-1e7b05ee6be1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:05.712492 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ce576b3c-c5ba-4965-bae3-1e7b05ee6be1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:05.718944 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce576b3c-c5ba-4965-bae3-1e7b05ee6be1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.719445 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce576b3c-c5ba-4965-bae3-1e7b05ee6be1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.720626 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce576b3c-c5ba-4965-bae3-1e7b05ee6be1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.720739 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce576b3c-c5ba-4965-bae3-1e7b05ee6be1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.721115 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce576b3c-c5ba-4965-bae3-1e7b05ee6be1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.726695 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce576b3c-c5ba-4965-bae3-1e7b05ee6be1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.816187 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d127ee88-319b-4979-b6b0-d79ddf5575ea tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:05.824109 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d127ee88-319b-4979-b6b0-d79ddf5575ea tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1548 microversion: 2.1 time: 0.196873 Sep 01 14:04:05.824542 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 221/447] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:05 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1548 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:05.846977 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a9e67cbd-ed17-4859-9dcd-e2ec71dbe71a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:05.847586 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a9e67cbd-ed17-4859-9dcd-e2ec71dbe71a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:05.854702 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a9e67cbd-ed17-4859-9dcd-e2ec71dbe71a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.855193 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a9e67cbd-ed17-4859-9dcd-e2ec71dbe71a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.855634 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a9e67cbd-ed17-4859-9dcd-e2ec71dbe71a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.856356 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a9e67cbd-ed17-4859-9dcd-e2ec71dbe71a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:05.856812 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a9e67cbd-ed17-4859-9dcd-e2ec71dbe71a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:05.857237 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a9e67cbd-ed17-4859-9dcd-e2ec71dbe71a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:05.903224 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ce576b3c-c5ba-4965-bae3-1e7b05ee6be1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:05.909960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ce576b3c-c5ba-4965-bae3-1e7b05ee6be1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1504 microversion: 2.1 time: 0.204512 Sep 01 14:04:05.911021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 227/448] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:05 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1504 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:06.055536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a9e67cbd-ed17-4859-9dcd-e2ec71dbe71a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:06.071138 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a9e67cbd-ed17-4859-9dcd-e2ec71dbe71a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.231609 Sep 01 14:04:06.072464 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 222/449] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:05 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:06.637863 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-fc8a7fd7-d7ea-4591-b48a-a99e4e989401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:06.638544 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-fc8a7fd7-d7ea-4591-b48a-a99e4e989401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:06.645139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fc8a7fd7-d7ea-4591-b48a-a99e4e989401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:06.645634 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fc8a7fd7-d7ea-4591-b48a-a99e4e989401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:06.646686 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fc8a7fd7-d7ea-4591-b48a-a99e4e989401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:06.647405 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fc8a7fd7-d7ea-4591-b48a-a99e4e989401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:06.647897 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fc8a7fd7-d7ea-4591-b48a-a99e4e989401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:06.648330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fc8a7fd7-d7ea-4591-b48a-a99e4e989401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:06.798545 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fc8a7fd7-d7ea-4591-b48a-a99e4e989401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:06.809006 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fc8a7fd7-d7ea-4591-b48a-a99e4e989401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:06.810736 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fc8a7fd7-d7ea-4591-b48a-a99e4e989401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:06.811933 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-fc8a7fd7-d7ea-4591-b48a-a99e4e989401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.178583 Sep 01 14:04:06.812510 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 228/450] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:06 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:06.948710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-31dbb8d6-3713-4706-b376-f2f56e2015be tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:06.951942 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-31dbb8d6-3713-4706-b376-f2f56e2015be tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:06.960627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31dbb8d6-3713-4706-b376-f2f56e2015be tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:06.973661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31dbb8d6-3713-4706-b376-f2f56e2015be tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:06.973661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31dbb8d6-3713-4706-b376-f2f56e2015be tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:06.973661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31dbb8d6-3713-4706-b376-f2f56e2015be tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:06.973661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31dbb8d6-3713-4706-b376-f2f56e2015be tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:06.974134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31dbb8d6-3713-4706-b376-f2f56e2015be tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:07.104991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-37316d2d-65bd-4644-86f5-fe08f690bcbf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:07.128119 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-37316d2d-65bd-4644-86f5-fe08f690bcbf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:07.128119 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37316d2d-65bd-4644-86f5-fe08f690bcbf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:07.128119 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37316d2d-65bd-4644-86f5-fe08f690bcbf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:07.128858 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37316d2d-65bd-4644-86f5-fe08f690bcbf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:07.129700 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37316d2d-65bd-4644-86f5-fe08f690bcbf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:07.131998 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37316d2d-65bd-4644-86f5-fe08f690bcbf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:07.134290 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37316d2d-65bd-4644-86f5-fe08f690bcbf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:07.338789 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-31dbb8d6-3713-4706-b376-f2f56e2015be tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:07.360096 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-31dbb8d6-3713-4706-b376-f2f56e2015be tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1504 microversion: 2.1 time: 0.427238 Sep 01 14:04:07.363907 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 223/451] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:06 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:07.417245 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-37316d2d-65bd-4644-86f5-fe08f690bcbf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:07.428964 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-37316d2d-65bd-4644-86f5-fe08f690bcbf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.332117 Sep 01 14:04:07.433177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 229/452] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:07 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:07.839953 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-684749e9-03a4-4f1a-a716-9ac5ec8091cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:07.841020 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-684749e9-03a4-4f1a-a716-9ac5ec8091cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:07.855227 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-684749e9-03a4-4f1a-a716-9ac5ec8091cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:07.855738 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-684749e9-03a4-4f1a-a716-9ac5ec8091cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:07.856189 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-684749e9-03a4-4f1a-a716-9ac5ec8091cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:07.857042 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-684749e9-03a4-4f1a-a716-9ac5ec8091cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:07.857507 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-684749e9-03a4-4f1a-a716-9ac5ec8091cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:07.857970 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-684749e9-03a4-4f1a-a716-9ac5ec8091cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:08.044419 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-684749e9-03a4-4f1a-a716-9ac5ec8091cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:08.055955 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-684749e9-03a4-4f1a-a716-9ac5ec8091cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:08.058028 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-684749e9-03a4-4f1a-a716-9ac5ec8091cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:08.059462 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-684749e9-03a4-4f1a-a716-9ac5ec8091cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.226277 Sep 01 14:04:08.060536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 224/453] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:07 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:08.400349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1642e56a-1bc6-4d9b-a235-b3f09a4bc98f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:08.406089 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1642e56a-1bc6-4d9b-a235-b3f09a4bc98f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:08.427579 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1642e56a-1bc6-4d9b-a235-b3f09a4bc98f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:08.432737 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1642e56a-1bc6-4d9b-a235-b3f09a4bc98f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:08.432737 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1642e56a-1bc6-4d9b-a235-b3f09a4bc98f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:08.432737 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1642e56a-1bc6-4d9b-a235-b3f09a4bc98f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:08.432737 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1642e56a-1bc6-4d9b-a235-b3f09a4bc98f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:08.433225 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1642e56a-1bc6-4d9b-a235-b3f09a4bc98f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:08.454842 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-078e842c-7128-49e2-84ba-dc417e106b55 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:08.455532 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-078e842c-7128-49e2-84ba-dc417e106b55 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:08.474634 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-078e842c-7128-49e2-84ba-dc417e106b55 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:08.484480 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-078e842c-7128-49e2-84ba-dc417e106b55 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:08.484480 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-078e842c-7128-49e2-84ba-dc417e106b55 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:08.484480 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-078e842c-7128-49e2-84ba-dc417e106b55 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:08.484480 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-078e842c-7128-49e2-84ba-dc417e106b55 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:08.484874 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-078e842c-7128-49e2-84ba-dc417e106b55 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:08.505577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:08.850446 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-078e842c-7128-49e2-84ba-dc417e106b55 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:08.851807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1642e56a-1bc6-4d9b-a235-b3f09a4bc98f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:08.860839 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-078e842c-7128-49e2-84ba-dc417e106b55 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.410542 Sep 01 14:04:08.869763 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 225/454] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:08 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:08.869763 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0ca5d3c7-46d9-4cb6-968c-233963fd0e91 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "490d8f23-76b5-4430-a262-935c6cd56c3c"}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:08.874227 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0ca5d3c7-46d9-4cb6-968c-233963fd0e91 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:08.885585 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0ca5d3c7-46d9-4cb6-968c-233963fd0e91 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:08.886180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0ca5d3c7-46d9-4cb6-968c-233963fd0e91 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:08.886809 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0ca5d3c7-46d9-4cb6-968c-233963fd0e91 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:08.887736 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0ca5d3c7-46d9-4cb6-968c-233963fd0e91 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:08.888356 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0ca5d3c7-46d9-4cb6-968c-233963fd0e91 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:08.888932 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0ca5d3c7-46d9-4cb6-968c-233963fd0e91 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:08.899716 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1642e56a-1bc6-4d9b-a235-b3f09a4bc98f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1504 microversion: 2.1 time: 0.506201 Sep 01 14:04:08.902498 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 230/455] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:08 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1504 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:09.086867 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-266b09de-1951-4f21-bc50-514d3661d833 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:09.087594 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-266b09de-1951-4f21-bc50-514d3661d833 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:09.095349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-266b09de-1951-4f21-bc50-514d3661d833 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:09.097087 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-266b09de-1951-4f21-bc50-514d3661d833 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:09.097087 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-266b09de-1951-4f21-bc50-514d3661d833 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:09.097432 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-266b09de-1951-4f21-bc50-514d3661d833 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:09.097849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-266b09de-1951-4f21-bc50-514d3661d833 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:09.098454 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-266b09de-1951-4f21-bc50-514d3661d833 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:09.311292 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-266b09de-1951-4f21-bc50-514d3661d833 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:09.329389 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-266b09de-1951-4f21-bc50-514d3661d833 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:09.329389 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-266b09de-1951-4f21-bc50-514d3661d833 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:09.330452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-266b09de-1951-4f21-bc50-514d3661d833 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.250352 Sep 01 14:04:09.331329 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 231/456] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:09 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:09.885401 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-90cd745b-9562-4434-8605-75a44b13369a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:09.886793 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-90cd745b-9562-4434-8605-75a44b13369a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:09.899280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-90cd745b-9562-4434-8605-75a44b13369a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:09.900070 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-90cd745b-9562-4434-8605-75a44b13369a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:09.900508 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-90cd745b-9562-4434-8605-75a44b13369a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:09.901191 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-90cd745b-9562-4434-8605-75a44b13369a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:09.901644 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-90cd745b-9562-4434-8605-75a44b13369a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:09.902129 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-90cd745b-9562-4434-8605-75a44b13369a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:10.094525 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-90cd745b-9562-4434-8605-75a44b13369a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:10.104808 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-90cd745b-9562-4434-8605-75a44b13369a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.223179 Sep 01 14:04:10.105488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 232/457] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:09 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:10.111253 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-76371afe-e1c6-484c-8c2c-fd4994333211 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:10.112088 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-76371afe-e1c6-484c-8c2c-fd4994333211 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:10.135530 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-76371afe-e1c6-484c-8c2c-fd4994333211 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:10.138711 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-76371afe-e1c6-484c-8c2c-fd4994333211 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:10.145115 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-76371afe-e1c6-484c-8c2c-fd4994333211 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:10.146784 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-76371afe-e1c6-484c-8c2c-fd4994333211 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:10.147566 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-76371afe-e1c6-484c-8c2c-fd4994333211 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:10.148276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-76371afe-e1c6-484c-8c2c-fd4994333211 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:10.342156 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-76371afe-e1c6-484c-8c2c-fd4994333211 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:10.352468 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-76371afe-e1c6-484c-8c2c-fd4994333211 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1504 microversion: 2.1 time: 0.245752 Sep 01 14:04:10.353504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 233/458] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:10 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:10.370904 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2b43ba77-2ef0-4953-8c06-24549ebcb977 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:10.371521 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2b43ba77-2ef0-4953-8c06-24549ebcb977 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:10.378463 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b43ba77-2ef0-4953-8c06-24549ebcb977 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:10.378990 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b43ba77-2ef0-4953-8c06-24549ebcb977 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:10.379463 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b43ba77-2ef0-4953-8c06-24549ebcb977 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:10.380176 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b43ba77-2ef0-4953-8c06-24549ebcb977 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:10.380628 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b43ba77-2ef0-4953-8c06-24549ebcb977 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:10.381065 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b43ba77-2ef0-4953-8c06-24549ebcb977 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:10.590410 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2b43ba77-2ef0-4953-8c06-24549ebcb977 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:10.602305 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2b43ba77-2ef0-4953-8c06-24549ebcb977 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:10.603769 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2b43ba77-2ef0-4953-8c06-24549ebcb977 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:10.605019 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2b43ba77-2ef0-4953-8c06-24549ebcb977 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.238022 Sep 01 14:04:10.605569 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 234/459] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:10 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:11.147922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9de93484-4260-4364-a525-c385394efacc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:11.149760 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9de93484-4260-4364-a525-c385394efacc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:11.165667 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9de93484-4260-4364-a525-c385394efacc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:11.166721 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9de93484-4260-4364-a525-c385394efacc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:11.168244 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9de93484-4260-4364-a525-c385394efacc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:11.169603 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9de93484-4260-4364-a525-c385394efacc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:11.170445 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9de93484-4260-4364-a525-c385394efacc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:11.177804 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9de93484-4260-4364-a525-c385394efacc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:11.434198 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9de93484-4260-4364-a525-c385394efacc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:11.458850 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9de93484-4260-4364-a525-c385394efacc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.322600 Sep 01 14:04:11.459722 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 235/460] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:11 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:11.464866 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-6546900d-357f-4cbe-bdf4-eadfae659a9f req-c209119c-e78b-43a2-96a6-4fe0dd502db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58", "name": "network-vif-unplugged", "status": "completed", "tag": "ae65f105-61e5-40e0-a2ad-e0283df21835"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:11.476949 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-6546900d-357f-4cbe-bdf4-eadfae659a9f req-c209119c-e78b-43a2-96a6-4fe0dd502db6 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:11.477962 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-6546900d-357f-4cbe-bdf4-eadfae659a9f req-c209119c-e78b-43a2-96a6-4fe0dd502db6 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:11.478851 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-6546900d-357f-4cbe-bdf4-eadfae659a9f req-c209119c-e78b-43a2-96a6-4fe0dd502db6 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:11.497102 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-6546900d-357f-4cbe-bdf4-eadfae659a9f req-c209119c-e78b-43a2-96a6-4fe0dd502db6 service nova] Creating event network-vif-unplugged:ae65f105-61e5-40e0-a2ad-e0283df21835 for instance 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 on hv-cinder-85221 Sep 01 14:04:11.507081 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-6546900d-357f-4cbe-bdf4-eadfae659a9f req-c209119c-e78b-43a2-96a6-4fe0dd502db6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045475 Sep 01 14:04:11.508989 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 236/461] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:11.520949 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-83b6227b-d689-4551-8513-c2fd8d085ae0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:11.522751 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-83b6227b-d689-4551-8513-c2fd8d085ae0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:11.537133 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-83b6227b-d689-4551-8513-c2fd8d085ae0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:11.538402 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-83b6227b-d689-4551-8513-c2fd8d085ae0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:11.539465 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-83b6227b-d689-4551-8513-c2fd8d085ae0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:11.540746 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-83b6227b-d689-4551-8513-c2fd8d085ae0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:11.541571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-83b6227b-d689-4551-8513-c2fd8d085ae0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:11.542378 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-83b6227b-d689-4551-8513-c2fd8d085ae0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:11.746776 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-83b6227b-d689-4551-8513-c2fd8d085ae0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:11.755780 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-83b6227b-d689-4551-8513-c2fd8d085ae0 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1504 microversion: 2.1 time: 0.243309 Sep 01 14:04:11.756368 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 237/462] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:11 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:11.769811 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3b5213f2-ff72-4c63-afd2-f91a3305a7cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:11.769811 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3b5213f2-ff72-4c63-afd2-f91a3305a7cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:11.774381 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b5213f2-ff72-4c63-afd2-f91a3305a7cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:11.775311 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b5213f2-ff72-4c63-afd2-f91a3305a7cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:11.775558 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b5213f2-ff72-4c63-afd2-f91a3305a7cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:11.776377 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b5213f2-ff72-4c63-afd2-f91a3305a7cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:11.776955 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b5213f2-ff72-4c63-afd2-f91a3305a7cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:11.777468 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b5213f2-ff72-4c63-afd2-f91a3305a7cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:11.971133 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3b5213f2-ff72-4c63-afd2-f91a3305a7cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:11.983869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3b5213f2-ff72-4c63-afd2-f91a3305a7cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:11.985344 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3b5213f2-ff72-4c63-afd2-f91a3305a7cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:11.986606 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3b5213f2-ff72-4c63-afd2-f91a3305a7cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.229318 Sep 01 14:04:11.987168 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 238/463] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:11 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:12.481462 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-de6ce4fb-bcb4-423f-b2e8-f43ed3c31147 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:12.482160 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-de6ce4fb-bcb4-423f-b2e8-f43ed3c31147 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:12.489423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-de6ce4fb-bcb4-423f-b2e8-f43ed3c31147 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:12.490031 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-de6ce4fb-bcb4-423f-b2e8-f43ed3c31147 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:12.490532 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-de6ce4fb-bcb4-423f-b2e8-f43ed3c31147 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:12.491250 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-de6ce4fb-bcb4-423f-b2e8-f43ed3c31147 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:12.491998 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-de6ce4fb-bcb4-423f-b2e8-f43ed3c31147 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:12.492429 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-de6ce4fb-bcb4-423f-b2e8-f43ed3c31147 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:12.653178 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-de6ce4fb-bcb4-423f-b2e8-f43ed3c31147 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:12.654444 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:12.661655 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-de6ce4fb-bcb4-423f-b2e8-f43ed3c31147 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.183876 Sep 01 14:04:12.667919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 239/464] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:12 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:12.787800 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-6efc00bb-5ea8-464d-b8a1-bb095e171df6 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:12.789631 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-6efc00bb-5ea8-464d-b8a1-bb095e171df6 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:12.801728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6efc00bb-5ea8-464d-b8a1-bb095e171df6 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:12.803071 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6efc00bb-5ea8-464d-b8a1-bb095e171df6 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:12.804086 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6efc00bb-5ea8-464d-b8a1-bb095e171df6 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:12.805333 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6efc00bb-5ea8-464d-b8a1-bb095e171df6 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:12.806192 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6efc00bb-5ea8-464d-b8a1-bb095e171df6 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:12.806950 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6efc00bb-5ea8-464d-b8a1-bb095e171df6 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:12.974694 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-6efc00bb-5ea8-464d-b8a1-bb095e171df6 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:12.982514 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-6efc00bb-5ea8-464d-b8a1-bb095e171df6 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1504 microversion: 2.1 time: 0.203507 Sep 01 14:04:12.983091 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 240/465] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:12 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1504 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:13.013177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-abba4bd9-ea23-4d69-afa9-3b09edf8504e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:13.013803 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-abba4bd9-ea23-4d69-afa9-3b09edf8504e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:13.020024 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-abba4bd9-ea23-4d69-afa9-3b09edf8504e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:13.020516 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-abba4bd9-ea23-4d69-afa9-3b09edf8504e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:13.020992 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-abba4bd9-ea23-4d69-afa9-3b09edf8504e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:13.021695 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-abba4bd9-ea23-4d69-afa9-3b09edf8504e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:13.022188 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-abba4bd9-ea23-4d69-afa9-3b09edf8504e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:13.022619 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-abba4bd9-ea23-4d69-afa9-3b09edf8504e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:13.187196 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-abba4bd9-ea23-4d69-afa9-3b09edf8504e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:13.197446 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-abba4bd9-ea23-4d69-afa9-3b09edf8504e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:13.199099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-abba4bd9-ea23-4d69-afa9-3b09edf8504e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:13.200327 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-abba4bd9-ea23-4d69-afa9-3b09edf8504e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.191232 Sep 01 14:04:13.201074 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 241/466] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:13 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:13.625560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f078b5ac-4488-4f55-8f27-183bc0bface6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:13.626288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f078b5ac-4488-4f55-8f27-183bc0bface6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:13.633600 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f078b5ac-4488-4f55-8f27-183bc0bface6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:13.634121 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f078b5ac-4488-4f55-8f27-183bc0bface6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:13.634552 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f078b5ac-4488-4f55-8f27-183bc0bface6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:13.635245 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f078b5ac-4488-4f55-8f27-183bc0bface6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:13.635697 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f078b5ac-4488-4f55-8f27-183bc0bface6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:13.636116 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f078b5ac-4488-4f55-8f27-183bc0bface6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:13.768628 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-f078b5ac-4488-4f55-8f27-183bc0bface6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'services' on Instance uuid 95b52d39-e40f-40a7-8bde-3d47790fb1d2 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:14.018350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f078b5ac-4488-4f55-8f27-183bc0bface6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/os-volume_attachments/901c84dc-0571-44e8-a50d-ed40ef86fc5f" status: 202 len: 0 microversion: 2.1 time: 0.396886 Sep 01 14:04:14.023175 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 242/467] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 1 14:04:13 2022] DELETE /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/os-volume_attachments/901c84dc-0571-44e8-a50d-ed40ef86fc5f => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:04:14.028880 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7c694f5f-b111-4b8b-9247-c6d86c17a284 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:14.029643 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7c694f5f-b111-4b8b-9247-c6d86c17a284 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:14.039056 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c694f5f-b111-4b8b-9247-c6d86c17a284 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:14.039555 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c694f5f-b111-4b8b-9247-c6d86c17a284 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:14.039991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c694f5f-b111-4b8b-9247-c6d86c17a284 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:14.040705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c694f5f-b111-4b8b-9247-c6d86c17a284 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:14.041353 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c694f5f-b111-4b8b-9247-c6d86c17a284 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:14.041973 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c694f5f-b111-4b8b-9247-c6d86c17a284 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:14.198922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7c694f5f-b111-4b8b-9247-c6d86c17a284 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:14.206914 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7c694f5f-b111-4b8b-9247-c6d86c17a284 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.182441 Sep 01 14:04:14.207485 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 243/468] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:14 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:14.212590 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c0b919dc-5927-4c29-b702-83fee997552d tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:14.213190 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c0b919dc-5927-4c29-b702-83fee997552d tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:14.221757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0b919dc-5927-4c29-b702-83fee997552d tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:14.222259 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0b919dc-5927-4c29-b702-83fee997552d tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:14.222692 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0b919dc-5927-4c29-b702-83fee997552d tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:14.223398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0b919dc-5927-4c29-b702-83fee997552d tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:14.223852 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0b919dc-5927-4c29-b702-83fee997552d tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:14.224293 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0b919dc-5927-4c29-b702-83fee997552d tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:14.375959 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c0b919dc-5927-4c29-b702-83fee997552d tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:14.386029 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c0b919dc-5927-4c29-b702-83fee997552d tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1504 microversion: 2.1 time: 0.177477 Sep 01 14:04:14.386610 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 244/469] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:14 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:14.391334 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ef545373-1727-4838-8d38-e1518eac383b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:14.391937 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ef545373-1727-4838-8d38-e1518eac383b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:14.398975 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ef545373-1727-4838-8d38-e1518eac383b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:14.399480 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ef545373-1727-4838-8d38-e1518eac383b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:14.399989 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ef545373-1727-4838-8d38-e1518eac383b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:14.400689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ef545373-1727-4838-8d38-e1518eac383b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:14.401145 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ef545373-1727-4838-8d38-e1518eac383b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:14.401570 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ef545373-1727-4838-8d38-e1518eac383b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:14.811715 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ef545373-1727-4838-8d38-e1518eac383b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:14.821935 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ef545373-1727-4838-8d38-e1518eac383b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:14.823392 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ef545373-1727-4838-8d38-e1518eac383b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:14.824608 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ef545373-1727-4838-8d38-e1518eac383b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.437073 Sep 01 14:04:14.825173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 245/470] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:14 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:15.228980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b3a3aad5-6a04-439e-8637-a6b382693307 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:15.229589 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b3a3aad5-6a04-439e-8637-a6b382693307 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:15.236067 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b3a3aad5-6a04-439e-8637-a6b382693307 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:15.236554 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b3a3aad5-6a04-439e-8637-a6b382693307 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:15.236988 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b3a3aad5-6a04-439e-8637-a6b382693307 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:15.237685 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b3a3aad5-6a04-439e-8637-a6b382693307 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:15.238198 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b3a3aad5-6a04-439e-8637-a6b382693307 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:15.238622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b3a3aad5-6a04-439e-8637-a6b382693307 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:15.416769 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-b3a3aad5-6a04-439e-8637-a6b382693307 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:15.425628 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b3a3aad5-6a04-439e-8637-a6b382693307 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.200426 Sep 01 14:04:15.427649 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 246/471] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:15 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:15.432073 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-46dd63eb-d374-4ce4-b711-1865bf13742c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:15.432794 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-46dd63eb-d374-4ce4-b711-1865bf13742c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:15.439179 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-46dd63eb-d374-4ce4-b711-1865bf13742c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:15.439759 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-46dd63eb-d374-4ce4-b711-1865bf13742c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:15.440312 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-46dd63eb-d374-4ce4-b711-1865bf13742c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:15.441133 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-46dd63eb-d374-4ce4-b711-1865bf13742c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:15.441694 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-46dd63eb-d374-4ce4-b711-1865bf13742c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:15.442209 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-46dd63eb-d374-4ce4-b711-1865bf13742c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:15.462320 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:15.610509 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-46dd63eb-d374-4ce4-b711-1865bf13742c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:15.635191 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-46dd63eb-d374-4ce4-b711-1865bf13742c tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1504 microversion: 2.1 time: 0.206860 Sep 01 14:04:15.635756 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 247/472] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:15 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:15.848243 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-28c548c7-4f5d-4001-bfcf-efb3cfcb6e73 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:15.849506 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-28c548c7-4f5d-4001-bfcf-efb3cfcb6e73 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:15.859594 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-28c548c7-4f5d-4001-bfcf-efb3cfcb6e73 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:15.860077 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-28c548c7-4f5d-4001-bfcf-efb3cfcb6e73 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:15.860500 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-28c548c7-4f5d-4001-bfcf-efb3cfcb6e73 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:15.861197 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-28c548c7-4f5d-4001-bfcf-efb3cfcb6e73 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:15.861642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-28c548c7-4f5d-4001-bfcf-efb3cfcb6e73 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:15.862090 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-28c548c7-4f5d-4001-bfcf-efb3cfcb6e73 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:16.027889 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-28c548c7-4f5d-4001-bfcf-efb3cfcb6e73 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:16.037847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-28c548c7-4f5d-4001-bfcf-efb3cfcb6e73 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:16.039774 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-28c548c7-4f5d-4001-bfcf-efb3cfcb6e73 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:16.040613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-28c548c7-4f5d-4001-bfcf-efb3cfcb6e73 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.196343 Sep 01 14:04:16.041275 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 248/473] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:15 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:04:16.448476 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-352d3ddf-7a28-4f7c-af32-60658e6f26b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:16.449043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-352d3ddf-7a28-4f7c-af32-60658e6f26b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:16.457050 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-352d3ddf-7a28-4f7c-af32-60658e6f26b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:16.457609 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-352d3ddf-7a28-4f7c-af32-60658e6f26b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:16.458634 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-352d3ddf-7a28-4f7c-af32-60658e6f26b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:16.461983 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-352d3ddf-7a28-4f7c-af32-60658e6f26b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:16.462524 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-352d3ddf-7a28-4f7c-af32-60658e6f26b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:16.463011 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-352d3ddf-7a28-4f7c-af32-60658e6f26b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:16.612198 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-352d3ddf-7a28-4f7c-af32-60658e6f26b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:16.621498 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-352d3ddf-7a28-4f7c-af32-60658e6f26b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.177230 Sep 01 14:04:16.622099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 249/474] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:16 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:16.656276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-292a5084-1920-4e72-b172-f56b712f83de tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:16.656875 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-292a5084-1920-4e72-b172-f56b712f83de tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:16.663306 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-292a5084-1920-4e72-b172-f56b712f83de tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:16.663830 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-292a5084-1920-4e72-b172-f56b712f83de tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:16.664315 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-292a5084-1920-4e72-b172-f56b712f83de tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:16.665062 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-292a5084-1920-4e72-b172-f56b712f83de tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:16.665435 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-292a5084-1920-4e72-b172-f56b712f83de tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:16.665885 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-292a5084-1920-4e72-b172-f56b712f83de tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:16.802606 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-292a5084-1920-4e72-b172-f56b712f83de tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:16.810319 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-292a5084-1920-4e72-b172-f56b712f83de tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1504 microversion: 2.1 time: 0.157877 Sep 01 14:04:16.810884 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 250/475] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:16 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1504 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:17.067445 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7d6f47c2-c731-4bcb-b5ae-3cb503f8c508 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:17.068462 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7d6f47c2-c731-4bcb-b5ae-3cb503f8c508 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:17.075374 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7d6f47c2-c731-4bcb-b5ae-3cb503f8c508 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:17.076154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7d6f47c2-c731-4bcb-b5ae-3cb503f8c508 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:17.076594 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7d6f47c2-c731-4bcb-b5ae-3cb503f8c508 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:17.077346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7d6f47c2-c731-4bcb-b5ae-3cb503f8c508 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:17.077842 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7d6f47c2-c731-4bcb-b5ae-3cb503f8c508 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:17.078275 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7d6f47c2-c731-4bcb-b5ae-3cb503f8c508 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:17.351477 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7d6f47c2-c731-4bcb-b5ae-3cb503f8c508 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:17.360314 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7d6f47c2-c731-4bcb-b5ae-3cb503f8c508 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:17.361751 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7d6f47c2-c731-4bcb-b5ae-3cb503f8c508 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:17.362937 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7d6f47c2-c731-4bcb-b5ae-3cb503f8c508 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.301685 Sep 01 14:04:17.363485 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 251/476] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:17 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:17.649674 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-afa17d8e-bb42-4bfb-9eff-f0cdf4aea79e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:17.650523 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-afa17d8e-bb42-4bfb-9eff-f0cdf4aea79e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:17.656789 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-afa17d8e-bb42-4bfb-9eff-f0cdf4aea79e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:17.661313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-afa17d8e-bb42-4bfb-9eff-f0cdf4aea79e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:17.661313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-afa17d8e-bb42-4bfb-9eff-f0cdf4aea79e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:17.661313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-afa17d8e-bb42-4bfb-9eff-f0cdf4aea79e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:17.661313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-afa17d8e-bb42-4bfb-9eff-f0cdf4aea79e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:17.661717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-afa17d8e-bb42-4bfb-9eff-f0cdf4aea79e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:17.816421 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-afa17d8e-bb42-4bfb-9eff-f0cdf4aea79e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:17.824370 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-afa17d8e-bb42-4bfb-9eff-f0cdf4aea79e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.179950 Sep 01 14:04:17.824944 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 252/477] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:17 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:17.831919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-25cd5514-aabb-48c9-b464-9165aff4fe7f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:17.832516 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-25cd5514-aabb-48c9-b464-9165aff4fe7f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:17.838404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-25cd5514-aabb-48c9-b464-9165aff4fe7f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:17.838886 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-25cd5514-aabb-48c9-b464-9165aff4fe7f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:17.839319 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-25cd5514-aabb-48c9-b464-9165aff4fe7f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:17.840001 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-25cd5514-aabb-48c9-b464-9165aff4fe7f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:17.840456 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-25cd5514-aabb-48c9-b464-9165aff4fe7f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:17.840872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-25cd5514-aabb-48c9-b464-9165aff4fe7f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:18.077685 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-25cd5514-aabb-48c9-b464-9165aff4fe7f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:18.083442 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-25cd5514-aabb-48c9-b464-9165aff4fe7f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1504 microversion: 2.1 time: 0.255252 Sep 01 14:04:18.084018 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 253/478] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:17 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:18.386830 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4ea150d7-e92a-4be7-a425-50b82b7b6d70 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:18.387449 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4ea150d7-e92a-4be7-a425-50b82b7b6d70 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:18.393404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4ea150d7-e92a-4be7-a425-50b82b7b6d70 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:18.393932 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4ea150d7-e92a-4be7-a425-50b82b7b6d70 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:18.394371 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4ea150d7-e92a-4be7-a425-50b82b7b6d70 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:18.395075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4ea150d7-e92a-4be7-a425-50b82b7b6d70 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:18.396014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4ea150d7-e92a-4be7-a425-50b82b7b6d70 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:18.396440 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4ea150d7-e92a-4be7-a425-50b82b7b6d70 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:18.527814 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0ca5d3c7-46d9-4cb6-968c-233963fd0e91 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "POST /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.664726 Sep 01 14:04:18.528508 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 226/479] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:04:08 2022] POST /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments => generated 194 bytes in 9666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:18.676664 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-797b411d-bd16-49a3-aa3f-26d5ea5d2f23 req-98e3de13-0d5c-4f9f-bbdc-7d33824a4fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58", "name": "network-vif-deleted", "tag": "ae65f105-61e5-40e0-a2ad-e0283df21835"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:18.686842 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:18.689151 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-797b411d-bd16-49a3-aa3f-26d5ea5d2f23 req-98e3de13-0d5c-4f9f-bbdc-7d33824a4fd7 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:18.689628 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-797b411d-bd16-49a3-aa3f-26d5ea5d2f23 req-98e3de13-0d5c-4f9f-bbdc-7d33824a4fd7 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:18.690084 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-797b411d-bd16-49a3-aa3f-26d5ea5d2f23 req-98e3de13-0d5c-4f9f-bbdc-7d33824a4fd7 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:18.691191 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4ea150d7-e92a-4be7-a425-50b82b7b6d70 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:18.703990 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4ea150d7-e92a-4be7-a425-50b82b7b6d70 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:18.704138 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-797b411d-bd16-49a3-aa3f-26d5ea5d2f23 req-98e3de13-0d5c-4f9f-bbdc-7d33824a4fd7 service nova] Creating event network-vif-deleted:ae65f105-61e5-40e0-a2ad-e0283df21835 for instance 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 on hv-cinder-85221 Sep 01 14:04:18.706180 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4ea150d7-e92a-4be7-a425-50b82b7b6d70 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:18.707687 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4ea150d7-e92a-4be7-a425-50b82b7b6d70 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.324972 Sep 01 14:04:18.709918 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 254/480] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:18 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:04:18.712877 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-797b411d-bd16-49a3-aa3f-26d5ea5d2f23 req-98e3de13-0d5c-4f9f-bbdc-7d33824a4fd7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040449 Sep 01 14:04:18.714287 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 227/481] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:04:18.845286 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d4090dd3-67d0-4f0e-bd9e-21d86bdbddc3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:18.845989 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d4090dd3-67d0-4f0e-bd9e-21d86bdbddc3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:18.852489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4090dd3-67d0-4f0e-bd9e-21d86bdbddc3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:18.853022 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4090dd3-67d0-4f0e-bd9e-21d86bdbddc3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:18.853472 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4090dd3-67d0-4f0e-bd9e-21d86bdbddc3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:18.854226 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4090dd3-67d0-4f0e-bd9e-21d86bdbddc3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:18.854684 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4090dd3-67d0-4f0e-bd9e-21d86bdbddc3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:18.855234 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4090dd3-67d0-4f0e-bd9e-21d86bdbddc3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:19.028040 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d4090dd3-67d0-4f0e-bd9e-21d86bdbddc3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:19.030411 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:19.037364 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d4090dd3-67d0-4f0e-bd9e-21d86bdbddc3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.196140 Sep 01 14:04:19.037982 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 255/482] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:18 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:19.106009 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:19.106720 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:19.114032 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:19.115019 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:19.115456 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:19.116168 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:19.117169 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:19.117169 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:19.150839 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:19.151319 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:19.151806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:19.152612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lazy-loading 'fault' on Instance uuid 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:19.196819 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:19.204692 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e89881ea-fad2-4ac0-93bd-2553ee0232f1 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1304 microversion: 2.1 time: 0.103876 Sep 01 14:04:19.205428 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 228/483] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:19 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:19.399870 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9ff7698c-399c-452b-8fff-9365c492ec60 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:19.406843 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9ff7698c-399c-452b-8fff-9365c492ec60 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:19.411811 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9ff7698c-399c-452b-8fff-9365c492ec60 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:19.411811 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9ff7698c-399c-452b-8fff-9365c492ec60 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:19.473276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9ff7698c-399c-452b-8fff-9365c492ec60 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Going to try to stop instance {{(pid=127811) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 14:04:19.667741 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9ff7698c-399c-452b-8fff-9365c492ec60 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "POST /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/action" status: 202 len: 0 microversion: 2.1 time: 0.272009 Sep 01 14:04:19.668349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 256/484] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:04:19 2022] POST /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:04:19.681797 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-994e8058-ae58-4f25-8c69-00e1ad678701 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:19.682443 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-994e8058-ae58-4f25-8c69-00e1ad678701 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:19.688783 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-994e8058-ae58-4f25-8c69-00e1ad678701 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:19.689270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-994e8058-ae58-4f25-8c69-00e1ad678701 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:19.689706 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-994e8058-ae58-4f25-8c69-00e1ad678701 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:19.690430 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-994e8058-ae58-4f25-8c69-00e1ad678701 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:19.690888 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-994e8058-ae58-4f25-8c69-00e1ad678701 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:19.691318 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-994e8058-ae58-4f25-8c69-00e1ad678701 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:19.733817 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-13b89e4f-fa18-4430-8a5b-ade35fa55a0d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:19.733817 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-13b89e4f-fa18-4430-8a5b-ade35fa55a0d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:19.739664 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13b89e4f-fa18-4430-8a5b-ade35fa55a0d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:19.740161 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13b89e4f-fa18-4430-8a5b-ade35fa55a0d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:19.740601 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13b89e4f-fa18-4430-8a5b-ade35fa55a0d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:19.741310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13b89e4f-fa18-4430-8a5b-ade35fa55a0d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:19.741764 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13b89e4f-fa18-4430-8a5b-ade35fa55a0d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:19.742296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13b89e4f-fa18-4430-8a5b-ade35fa55a0d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:19.905149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-994e8058-ae58-4f25-8c69-00e1ad678701 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:19.908238 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-994e8058-ae58-4f25-8c69-00e1ad678701 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.230185 Sep 01 14:04:19.908817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 229/485] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:19 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:19.927356 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-13b89e4f-fa18-4430-8a5b-ade35fa55a0d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:19.936128 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-13b89e4f-fa18-4430-8a5b-ade35fa55a0d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:19.937569 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-13b89e4f-fa18-4430-8a5b-ade35fa55a0d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:19.938759 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-13b89e4f-fa18-4430-8a5b-ade35fa55a0d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.210550 Sep 01 14:04:19.939316 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 257/486] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:19 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:04:20.059907 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2a6999ef-b74b-4d6e-8cc2-071928bcc980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:20.060748 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2a6999ef-b74b-4d6e-8cc2-071928bcc980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:20.067871 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2a6999ef-b74b-4d6e-8cc2-071928bcc980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.068661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2a6999ef-b74b-4d6e-8cc2-071928bcc980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.069129 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2a6999ef-b74b-4d6e-8cc2-071928bcc980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.069924 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2a6999ef-b74b-4d6e-8cc2-071928bcc980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.070416 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2a6999ef-b74b-4d6e-8cc2-071928bcc980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.070885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2a6999ef-b74b-4d6e-8cc2-071928bcc980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.213541 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2a6999ef-b74b-4d6e-8cc2-071928bcc980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:20.221802 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2a6999ef-b74b-4d6e-8cc2-071928bcc980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.166398 Sep 01 14:04:20.222455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 230/487] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:20 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:20.229762 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:20.230392 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:20.236518 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.236999 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.240163 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.240163 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.240163 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.240163 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.274903 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.275441 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.275875 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.276318 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lazy-loading 'fault' on Instance uuid 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:20.322373 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:20.330184 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-92ff1797-5db7-4868-95c8-b7e967f30329 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1304 microversion: 2.1 time: 0.104198 Sep 01 14:04:20.331091 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 258/488] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:20 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:20.929926 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6d94954b-2826-4df9-8307-c17f56a314bc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:20.930477 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-6d94954b-2826-4df9-8307-c17f56a314bc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:20.936434 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6d94954b-2826-4df9-8307-c17f56a314bc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.936908 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6d94954b-2826-4df9-8307-c17f56a314bc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.937352 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6d94954b-2826-4df9-8307-c17f56a314bc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.938072 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6d94954b-2826-4df9-8307-c17f56a314bc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.938526 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6d94954b-2826-4df9-8307-c17f56a314bc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.938959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6d94954b-2826-4df9-8307-c17f56a314bc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.961443 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3f03ff2f-5823-4477-9fc9-fe5ac4d86c72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:20.962060 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3f03ff2f-5823-4477-9fc9-fe5ac4d86c72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:20.968508 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3f03ff2f-5823-4477-9fc9-fe5ac4d86c72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.968986 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3f03ff2f-5823-4477-9fc9-fe5ac4d86c72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.969417 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3f03ff2f-5823-4477-9fc9-fe5ac4d86c72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:20.970125 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3f03ff2f-5823-4477-9fc9-fe5ac4d86c72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:20.970571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3f03ff2f-5823-4477-9fc9-fe5ac4d86c72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:20.970991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3f03ff2f-5823-4477-9fc9-fe5ac4d86c72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:21.166466 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-6d94954b-2826-4df9-8307-c17f56a314bc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:21.174596 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3f03ff2f-5823-4477-9fc9-fe5ac4d86c72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:21.174780 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6d94954b-2826-4df9-8307-c17f56a314bc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1723 microversion: 2.1 time: 0.249538 Sep 01 14:04:21.175312 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 231/489] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:20 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:21.186022 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3f03ff2f-5823-4477-9fc9-fe5ac4d86c72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:21.187804 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3f03ff2f-5823-4477-9fc9-fe5ac4d86c72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:21.189321 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3f03ff2f-5823-4477-9fc9-fe5ac4d86c72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.231616 Sep 01 14:04:21.190048 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 259/490] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:20 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:04:21.245179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c012a8bf-b3c7-467c-9801-7032ca7971cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:21.245818 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c012a8bf-b3c7-467c-9801-7032ca7971cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:21.252136 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c012a8bf-b3c7-467c-9801-7032ca7971cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:21.252633 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c012a8bf-b3c7-467c-9801-7032ca7971cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:21.253072 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c012a8bf-b3c7-467c-9801-7032ca7971cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:21.253838 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c012a8bf-b3c7-467c-9801-7032ca7971cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:21.254297 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c012a8bf-b3c7-467c-9801-7032ca7971cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:21.254725 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c012a8bf-b3c7-467c-9801-7032ca7971cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:21.366364 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:21.366364 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:21.374807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:21.375324 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:21.375771 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:21.376480 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:21.376926 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:21.377354 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:21.416487 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c012a8bf-b3c7-467c-9801-7032ca7971cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:21.422808 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:21.423292 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:21.423719 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:21.424163 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lazy-loading 'fault' on Instance uuid 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:21.424637 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c012a8bf-b3c7-467c-9801-7032ca7971cd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1509 microversion: 2.1 time: 0.184674 Sep 01 14:04:21.425223 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 232/491] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:21 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:21.467415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:21.487539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d8cbd15d-2ff1-4fb2-a121-cc70b4791d32 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1304 microversion: 2.1 time: 0.138647 Sep 01 14:04:21.488144 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 260/492] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:21 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:21.528306 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-eb09283c-8db3-4ff5-bc53-c43315cc8aa1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:21.528790 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-eb09283c-8db3-4ff5-bc53-c43315cc8aa1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:21.537754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eb09283c-8db3-4ff5-bc53-c43315cc8aa1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:21.538279 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eb09283c-8db3-4ff5-bc53-c43315cc8aa1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:21.538711 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eb09283c-8db3-4ff5-bc53-c43315cc8aa1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:21.539406 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eb09283c-8db3-4ff5-bc53-c43315cc8aa1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:21.539855 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eb09283c-8db3-4ff5-bc53-c43315cc8aa1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:21.540279 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eb09283c-8db3-4ff5-bc53-c43315cc8aa1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:21.564299 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-eb09283c-8db3-4ff5-bc53-c43315cc8aa1 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11/ips" status: 200 len: 151 microversion: 2.1 time: 0.039750 Sep 01 14:04:21.564867 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 233/493] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 1 14:04:21 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:21.577234 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-650d51fb-9b34-46fb-a668-a5966a80d9af tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "164d3bed-2366-46d9-a136-3778741c0854"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:21.579850 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-650d51fb-9b34-46fb-a668-a5966a80d9af tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:21.588189 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-650d51fb-9b34-46fb-a668-a5966a80d9af tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:21.588690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-650d51fb-9b34-46fb-a668-a5966a80d9af tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:21.589195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-650d51fb-9b34-46fb-a668-a5966a80d9af tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:21.590025 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-650d51fb-9b34-46fb-a668-a5966a80d9af tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:21.590682 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-650d51fb-9b34-46fb-a668-a5966a80d9af tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:21.591384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-650d51fb-9b34-46fb-a668-a5966a80d9af tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:21.680254 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-650d51fb-9b34-46fb-a668-a5966a80d9af tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Invalid volume: volume 164d3bed-2366-46d9-a136-3778741c0854 is already attached to instances: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-650d51fb-9b34-46fb-a668-a5966a80d9af tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: POST /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11/os-volume_attachments HTTP/1.1 Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 74 Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:04:21.682043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:04:21.683676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:04:21.683676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:04:21.683676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:04:21.683676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:04:21.683676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:04:21.683676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:04:21.683676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:04:21.683676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:04:21.683676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:04:21.683676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Sep 01 14:04:21.683676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {"volumeAttachment": {"volumeId": "164d3bed-2366-46d9-a136-3778741c0854"}} Sep 01 14:04:21.683676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Invalid volume: volume 164d3bed-2366-46d9-a136-3778741c0854 is already attached to instances: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'server_id': '237052f9-426e-430e-b59c-ffc2f03c9e11', 'body': {'volumeAttachment': {'volumeId': '164d3bed-2366-46d9-a136-3778741c0854'}}} Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 164d3bed-2366-46d9-a136-3778741c0854 is already attached to instances: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:21.684586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 164d3bed-2366-46d9-a136-3778741c0854 is already attached to instances: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:21.686620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:04:21.689263 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:04:21.689263 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:04:21.689263 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:04:21.689263 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 164d3bed-2366-46d9-a136-3778741c0854 is already attached to instances: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa Sep 01 14:04:21.689263 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:21.689263 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-650d51fb-9b34-46fb-a668-a5966a80d9af tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 400 to user: Invalid volume: volume 164d3bed-2366-46d9-a136-3778741c0854 is already attached to instances: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:04:21.689263 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-650d51fb-9b34-46fb-a668-a5966a80d9af tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "POST /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110664 Sep 01 14:04:21.689263 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 261/494] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:04:21 2022] POST /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11/os-volume_attachments => generated 174 bytes in 112 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:04:21.695493 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d5c3d52f-02d4-4783-8902-9b65d91b3876 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:21.696096 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d5c3d52f-02d4-4783-8902-9b65d91b3876 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:21.702427 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d5c3d52f-02d4-4783-8902-9b65d91b3876 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:21.702947 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d5c3d52f-02d4-4783-8902-9b65d91b3876 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:21.703516 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d5c3d52f-02d4-4783-8902-9b65d91b3876 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:21.704231 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d5c3d52f-02d4-4783-8902-9b65d91b3876 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:21.704723 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d5c3d52f-02d4-4783-8902-9b65d91b3876 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:21.705220 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d5c3d52f-02d4-4783-8902-9b65d91b3876 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:21.734296 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d5c3d52f-02d4-4783-8902-9b65d91b3876 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Going to try to terminate instance {{(pid=127812) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:04:22.196710 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-12b9b65f-f549-4bda-91a7-45748b7fcb0a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:22.197346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-12b9b65f-f549-4bda-91a7-45748b7fcb0a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:22.205024 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-12b9b65f-f549-4bda-91a7-45748b7fcb0a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:22.205564 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-12b9b65f-f549-4bda-91a7-45748b7fcb0a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:22.206027 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-12b9b65f-f549-4bda-91a7-45748b7fcb0a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:22.206733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-12b9b65f-f549-4bda-91a7-45748b7fcb0a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:22.207203 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-12b9b65f-f549-4bda-91a7-45748b7fcb0a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:22.207615 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-12b9b65f-f549-4bda-91a7-45748b7fcb0a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:22.258352 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d5c3d52f-02d4-4783-8902-9b65d91b3876 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 204 len: 0 microversion: 2.1 time: 0.567528 Sep 01 14:04:22.259042 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 234/495] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:04:21 2022] DELETE /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:04:22.265639 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-bd097b79-b0cb-4c11-8f8c-4eaf6447a5c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:22.265639 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-bd097b79-b0cb-4c11-8f8c-4eaf6447a5c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:22.271784 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bd097b79-b0cb-4c11-8f8c-4eaf6447a5c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:22.272274 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bd097b79-b0cb-4c11-8f8c-4eaf6447a5c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:22.272741 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bd097b79-b0cb-4c11-8f8c-4eaf6447a5c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:22.273445 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bd097b79-b0cb-4c11-8f8c-4eaf6447a5c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:22.273936 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bd097b79-b0cb-4c11-8f8c-4eaf6447a5c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:22.278474 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bd097b79-b0cb-4c11-8f8c-4eaf6447a5c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:22.408404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-12b9b65f-f549-4bda-91a7-45748b7fcb0a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:22.416669 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-12b9b65f-f549-4bda-91a7-45748b7fcb0a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1677 microversion: 2.1 time: 0.224114 Sep 01 14:04:22.417290 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 262/496] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:22 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1677 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:22.422488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c2a1b7c8-31aa-49aa-8a67-6d9186cc7c66 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:22.423076 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c2a1b7c8-31aa-49aa-8a67-6d9186cc7c66 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:22.433275 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c2a1b7c8-31aa-49aa-8a67-6d9186cc7c66 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:22.434009 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c2a1b7c8-31aa-49aa-8a67-6d9186cc7c66 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:22.435207 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c2a1b7c8-31aa-49aa-8a67-6d9186cc7c66 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:22.435533 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c2a1b7c8-31aa-49aa-8a67-6d9186cc7c66 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:22.436089 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c2a1b7c8-31aa-49aa-8a67-6d9186cc7c66 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:22.436571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c2a1b7c8-31aa-49aa-8a67-6d9186cc7c66 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:22.445486 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-bd097b79-b0cb-4c11-8f8c-4eaf6447a5c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:22.454255 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-bd097b79-b0cb-4c11-8f8c-4eaf6447a5c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:22.456555 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-bd097b79-b0cb-4c11-8f8c-4eaf6447a5c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:22.458004 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-bd097b79-b0cb-4c11-8f8c-4eaf6447a5c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.197813 Sep 01 14:04:22.474288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 235/497] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:22 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:22.474288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-78ed5570-e614-4317-a83f-b93895a944de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:22.474288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-78ed5570-e614-4317-a83f-b93895a944de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:22.474288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78ed5570-e614-4317-a83f-b93895a944de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:22.474780 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78ed5570-e614-4317-a83f-b93895a944de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:22.474780 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78ed5570-e614-4317-a83f-b93895a944de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:22.474780 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78ed5570-e614-4317-a83f-b93895a944de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:22.474780 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78ed5570-e614-4317-a83f-b93895a944de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:22.475124 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78ed5570-e614-4317-a83f-b93895a944de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:22.631866 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c2a1b7c8-31aa-49aa-8a67-6d9186cc7c66 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:22.644436 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c2a1b7c8-31aa-49aa-8a67-6d9186cc7c66 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1683 microversion: 2.1 time: 0.225399 Sep 01 14:04:22.645019 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 263/498] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:22 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1683 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:22.650189 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:22.650933 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:22.658458 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-78ed5570-e614-4317-a83f-b93895a944de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:22.658945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:22.659602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:22.660069 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:22.660770 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:22.661223 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:22.661670 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:22.666153 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-78ed5570-e614-4317-a83f-b93895a944de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1515 microversion: 2.1 time: 0.206614 Sep 01 14:04:22.671552 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 236/499] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:22 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1515 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:22.698496 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:22.699119 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:22.699484 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:22.700013 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lazy-loading 'fault' on Instance uuid 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:22.743235 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:22.751464 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-099b4a58-084e-4b4b-aec2-a32374158507 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1304 microversion: 2.1 time: 0.105244 Sep 01 14:04:22.761216 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 264/500] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:22 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1304 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:23.438364 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b8dc292a-6f4c-4547-bf93-d7d449549ab2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:23.438968 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b8dc292a-6f4c-4547-bf93-d7d449549ab2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:23.446221 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b8dc292a-6f4c-4547-bf93-d7d449549ab2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:23.446802 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b8dc292a-6f4c-4547-bf93-d7d449549ab2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:23.447440 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b8dc292a-6f4c-4547-bf93-d7d449549ab2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:23.448297 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b8dc292a-6f4c-4547-bf93-d7d449549ab2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:23.448881 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b8dc292a-6f4c-4547-bf93-d7d449549ab2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:23.449401 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b8dc292a-6f4c-4547-bf93-d7d449549ab2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:23.481113 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-486ea4a1-03f2-4879-b005-61cd1f7c9d2f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:23.481905 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-486ea4a1-03f2-4879-b005-61cd1f7c9d2f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:23.488850 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-486ea4a1-03f2-4879-b005-61cd1f7c9d2f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:23.489432 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-486ea4a1-03f2-4879-b005-61cd1f7c9d2f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:23.490010 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-486ea4a1-03f2-4879-b005-61cd1f7c9d2f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:23.490845 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-486ea4a1-03f2-4879-b005-61cd1f7c9d2f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:23.491303 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-486ea4a1-03f2-4879-b005-61cd1f7c9d2f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:23.491907 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-486ea4a1-03f2-4879-b005-61cd1f7c9d2f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:23.647063 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b8dc292a-6f4c-4547-bf93-d7d449549ab2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:23.655010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b8dc292a-6f4c-4547-bf93-d7d449549ab2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1677 microversion: 2.1 time: 0.220484 Sep 01 14:04:23.655593 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 237/501] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:23 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:23.665376 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b6c06442-7493-4409-a387-02466d26371f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:23.666506 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b6c06442-7493-4409-a387-02466d26371f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:23.672960 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b6c06442-7493-4409-a387-02466d26371f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:23.673584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b6c06442-7493-4409-a387-02466d26371f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:23.674113 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b6c06442-7493-4409-a387-02466d26371f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:23.674880 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b6c06442-7493-4409-a387-02466d26371f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:23.675329 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b6c06442-7493-4409-a387-02466d26371f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:23.678799 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b6c06442-7493-4409-a387-02466d26371f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:23.681990 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-486ea4a1-03f2-4879-b005-61cd1f7c9d2f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:23.691632 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-486ea4a1-03f2-4879-b005-61cd1f7c9d2f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:23.693134 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-486ea4a1-03f2-4879-b005-61cd1f7c9d2f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:23.694346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-486ea4a1-03f2-4879-b005-61cd1f7c9d2f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.217188 Sep 01 14:04:23.694904 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 265/502] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:23 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:23.773439 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:23.774151 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:23.780078 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:23.780557 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:23.780982 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:23.781668 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:23.782160 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:23.782602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:23.813744 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:23.814252 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:23.814679 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:23.814796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b6c06442-7493-4409-a387-02466d26371f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:23.815114 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lazy-loading 'fault' on Instance uuid 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:23.823105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b6c06442-7493-4409-a387-02466d26371f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1683 microversion: 2.1 time: 0.162292 Sep 01 14:04:23.823762 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 238/503] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:23 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:23.857227 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:23.865339 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-5f2abd3b-b44f-43b8-9894-be4ebb8bddb2 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1304 microversion: 2.1 time: 0.096411 Sep 01 14:04:23.865933 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 266/504] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:23 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:24.441544 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-bc03baf3-04ea-4cf1-81ac-60fc6f03610d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Action: 'create', calling method: .version_select at 0x7f1afd498dc0>, body: {"keypair": {"name": "tempest-keypair-54805747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRMgl7KkjszXq9yjYkE+miya1rSMRIe0woKVY/NDdFmSLsaevYgHEA1hNSwA1ucyPZ/xMXwK+vQmCfjwkzloEfglhylcfd94+17Af/GyrAh3/Hq1nf4eB9NxzRVprQtyw=="}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:24.466479 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-bc03baf3-04ea-4cf1-81ac-60fc6f03610d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Getting quotas for project dce10589b8b240e6829f2e158415a1b8. Resources: {'key_pairs'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:04:24.477688 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-bc03baf3-04ea-4cf1-81ac-60fc6f03610d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Getting quotas for user 65c88d8b86544ab5825adbadb26b1e2e and project dce10589b8b240e6829f2e158415a1b8. Resources: {'key_pairs'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:04:24.597635 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-bc03baf3-04ea-4cf1-81ac-60fc6f03610d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.159958 Sep 01 14:04:24.598260 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 239/505] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 1 14:04:24 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:24.676523 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4fd5e6fa-236c-4494-a40d-727d12c39486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:24.677122 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4fd5e6fa-236c-4494-a40d-727d12c39486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:24.683733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4fd5e6fa-236c-4494-a40d-727d12c39486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:24.684218 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4fd5e6fa-236c-4494-a40d-727d12c39486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:24.684654 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4fd5e6fa-236c-4494-a40d-727d12c39486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:24.685376 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4fd5e6fa-236c-4494-a40d-727d12c39486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:24.685864 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4fd5e6fa-236c-4494-a40d-727d12c39486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:24.686292 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4fd5e6fa-236c-4494-a40d-727d12c39486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:24.716921 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9662ee0b-6a27-4e8b-b3e6-bcd132fd7808 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:24.717632 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9662ee0b-6a27-4e8b-b3e6-bcd132fd7808 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:24.724374 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9662ee0b-6a27-4e8b-b3e6-bcd132fd7808 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:24.725135 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9662ee0b-6a27-4e8b-b3e6-bcd132fd7808 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:24.725458 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9662ee0b-6a27-4e8b-b3e6-bcd132fd7808 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:24.726196 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9662ee0b-6a27-4e8b-b3e6-bcd132fd7808 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:24.726678 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9662ee0b-6a27-4e8b-b3e6-bcd132fd7808 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:24.727115 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9662ee0b-6a27-4e8b-b3e6-bcd132fd7808 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:24.747054 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:24.934626 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4fd5e6fa-236c-4494-a40d-727d12c39486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:24.942962 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4fd5e6fa-236c-4494-a40d-727d12c39486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1677 microversion: 2.1 time: 0.270254 Sep 01 14:04:24.943973 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 267/506] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:24 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1677 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:24.948814 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8b06ecbd-b792-4644-b62f-101bd1632254 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:24.949419 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8b06ecbd-b792-4644-b62f-101bd1632254 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:24.955660 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b06ecbd-b792-4644-b62f-101bd1632254 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:24.956469 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b06ecbd-b792-4644-b62f-101bd1632254 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:24.956905 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b06ecbd-b792-4644-b62f-101bd1632254 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:24.958349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b06ecbd-b792-4644-b62f-101bd1632254 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:24.959034 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b06ecbd-b792-4644-b62f-101bd1632254 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:24.959614 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b06ecbd-b792-4644-b62f-101bd1632254 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:24.967042 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9662ee0b-6a27-4e8b-b3e6-bcd132fd7808 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:24.982759 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9662ee0b-6a27-4e8b-b3e6-bcd132fd7808 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:24.984344 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9662ee0b-6a27-4e8b-b3e6-bcd132fd7808 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:24.985588 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9662ee0b-6a27-4e8b-b3e6-bcd132fd7808 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.273062 Sep 01 14:04:24.994398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 240/507] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:24 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:24.994398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:24.994398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:24.998693 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:24.999191 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:25.004280 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:25.004280 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:25.004280 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:25.004280 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:25.033423 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:25.033958 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:25.034406 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:25.034846 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lazy-loading 'fault' on Instance uuid 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:25.142703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:25.159740 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-24c0deeb-77d8-40be-ba05-3ebbee462efa tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1304 microversion: 2.1 time: 0.172442 Sep 01 14:04:25.162419 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 241/508] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:24 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1304 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:25.182258 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-8b06ecbd-b792-4644-b62f-101bd1632254 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:25.190513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8b06ecbd-b792-4644-b62f-101bd1632254 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1683 microversion: 2.1 time: 0.245362 Sep 01 14:04:25.191171 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 268/509] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:24 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1683 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:25.965013 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f857a8e5-b67c-4e6e-b4f8-357135951015 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:25.965617 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f857a8e5-b67c-4e6e-b4f8-357135951015 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:25.972091 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f857a8e5-b67c-4e6e-b4f8-357135951015 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:25.972582 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f857a8e5-b67c-4e6e-b4f8-357135951015 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:25.973016 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f857a8e5-b67c-4e6e-b4f8-357135951015 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:25.974374 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f857a8e5-b67c-4e6e-b4f8-357135951015 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:25.974837 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f857a8e5-b67c-4e6e-b4f8-357135951015 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:25.975267 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f857a8e5-b67c-4e6e-b4f8-357135951015 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:26.009653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1d62985e-fac5-434e-8539-42341c0247d0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:26.010306 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1d62985e-fac5-434e-8539-42341c0247d0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:26.018926 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d62985e-fac5-434e-8539-42341c0247d0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:26.019509 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d62985e-fac5-434e-8539-42341c0247d0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:26.020019 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d62985e-fac5-434e-8539-42341c0247d0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:26.021580 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d62985e-fac5-434e-8539-42341c0247d0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:26.022134 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d62985e-fac5-434e-8539-42341c0247d0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:26.022963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1d62985e-fac5-434e-8539-42341c0247d0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:26.181434 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f857a8e5-b67c-4e6e-b4f8-357135951015 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:26.188593 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f857a8e5-b67c-4e6e-b4f8-357135951015 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1677 microversion: 2.1 time: 0.227386 Sep 01 14:04:26.196512 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 242/510] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:25 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1677 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:26.215013 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:26.215644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:26.220211 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1d62985e-fac5-434e-8539-42341c0247d0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:26.230896 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1d62985e-fac5-434e-8539-42341c0247d0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:26.232716 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1d62985e-fac5-434e-8539-42341c0247d0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:26.233980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1d62985e-fac5-434e-8539-42341c0247d0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.229354 Sep 01 14:04:26.234195 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:26.234717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 269/511] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:26 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:04:26.240294 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1ba84495-13da-42b4-b518-55bbf553f7f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:26.241484 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1ba84495-13da-42b4-b518-55bbf553f7f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:26.247041 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:26.247566 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:26.248333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:26.249067 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:26.249519 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:26.252462 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ba84495-13da-42b4-b518-55bbf553f7f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:26.253153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ba84495-13da-42b4-b518-55bbf553f7f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:26.253757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ba84495-13da-42b4-b518-55bbf553f7f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:26.254509 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ba84495-13da-42b4-b518-55bbf553f7f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:26.255493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ba84495-13da-42b4-b518-55bbf553f7f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:26.256142 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ba84495-13da-42b4-b518-55bbf553f7f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:26.260847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:26.298919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:26.299411 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:26.299857 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:26.300312 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lazy-loading 'fault' on Instance uuid 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:26.368490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c60f6eaccad440abff863fe99b40382', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '596cdff155be4dc997ce351b7cd6db08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:26.386478 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0cb40c19-7385-4347-a09f-f5712726923f tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 200 len: 1304 microversion: 2.1 time: 0.189796 Sep 01 14:04:26.387456 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 243/512] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:26 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 1304 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:26.455571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1ba84495-13da-42b4-b518-55bbf553f7f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:26.464089 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1ba84495-13da-42b4-b518-55bbf553f7f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1683 microversion: 2.1 time: 0.228135 Sep 01 14:04:26.464654 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 270/513] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:26 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1683 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:27.214473 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6616e04a-c68a-4a9f-ac18-e6528a74428c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:27.217122 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-6616e04a-c68a-4a9f-ac18-e6528a74428c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:27.234315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6616e04a-c68a-4a9f-ac18-e6528a74428c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:27.234819 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6616e04a-c68a-4a9f-ac18-e6528a74428c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:27.235261 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6616e04a-c68a-4a9f-ac18-e6528a74428c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:27.241857 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6616e04a-c68a-4a9f-ac18-e6528a74428c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:27.242347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6616e04a-c68a-4a9f-ac18-e6528a74428c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:27.242788 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6616e04a-c68a-4a9f-ac18-e6528a74428c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:27.262790 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-dd8aa29c-2bb2-475e-be9d-bf037080a64a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:27.264500 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-dd8aa29c-2bb2-475e-be9d-bf037080a64a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:27.275534 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dd8aa29c-2bb2-475e-be9d-bf037080a64a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:27.277543 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dd8aa29c-2bb2-475e-be9d-bf037080a64a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:27.279919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dd8aa29c-2bb2-475e-be9d-bf037080a64a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:27.280955 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dd8aa29c-2bb2-475e-be9d-bf037080a64a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:27.281894 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dd8aa29c-2bb2-475e-be9d-bf037080a64a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:27.284810 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dd8aa29c-2bb2-475e-be9d-bf037080a64a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:27.650992 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-dd8aa29c-2bb2-475e-be9d-bf037080a64a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:27.655828 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-6616e04a-c68a-4a9f-ac18-e6528a74428c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:27.660781 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-dd8aa29c-2bb2-475e-be9d-bf037080a64a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:27.662912 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-dd8aa29c-2bb2-475e-be9d-bf037080a64a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:27.666346 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6616e04a-c68a-4a9f-ac18-e6528a74428c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1677 microversion: 2.1 time: 0.458017 Sep 01 14:04:27.666471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-dd8aa29c-2bb2-475e-be9d-bf037080a64a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.407534 Sep 01 14:04:27.666553 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 244/514] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:27 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1677 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:27.666631 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 271/515] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:27 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:04:27.671203 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-994ab262-6b9e-4d36-ae25-19607d1bd427 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:27.671801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-994ab262-6b9e-4d36-ae25-19607d1bd427 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] [instance: 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:27.674722 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:27.685549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1195476828", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "241bed09-c819-467f-87d6-202417ebcf87"}], "security_groups": [{"name": "tempest-securitygroup--311900758"}], "key_name": "tempest-keypair-54805747", "user_data": "}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:27.687497 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-994ab262-6b9e-4d36-ae25-19607d1bd427 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:27.688001 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-994ab262-6b9e-4d36-ae25-19607d1bd427 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:27.688456 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-994ab262-6b9e-4d36-ae25-19607d1bd427 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:27.689182 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-994ab262-6b9e-4d36-ae25-19607d1bd427 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:27.693177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-994ab262-6b9e-4d36-ae25-19607d1bd427 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:27.694890 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-994ab262-6b9e-4d36-ae25-19607d1bd427 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:27.709983 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-994ab262-6b9e-4d36-ae25-19607d1bd427 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] HTTP exception thrown: Instance 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 could not be found. Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-994ab262-6b9e-4d36-ae25-19607d1bd427 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Request method failure captured: Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 HTTP/1.1 Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELuGepC3YL5_TwNTmgnhfJ2txaQ0Y-qI1gH6kERFCsWeZdyo32KJvUPbqw1FU9lLC1e41zQSa1DcKkzGIUEecx17-vU80nVM5WY7pgU2QnD1nFTZj3099A4QYcLPivbIB9I0EQ5-mM0hYL5iehWumdTzKMIGrxZTki7TjAKiUDM1MCE Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 596cdff155be4dc997ce351b7cd6db08 Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-VolumesActionsTest-479162025 Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:04:27.711658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:04:27.713219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/596cdff155be4dc997ce351b7cd6db08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/596cdff155be4dc997ce351b7cd6db08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/596cdff155be4dc997ce351b7cd6db08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_596cdff155be4dc997ce351b7cd6db08"}]}] Sep 01 14:04:27.713219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-VolumesActionsTest-479162025 Sep 01 14:04:27.713219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 596cdff155be4dc997ce351b7cd6db08 Sep 01 14:04:27.713219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-VolumesActionsTest-479162025 Sep 01 14:04:27.713219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-VolumesActionsTest-479162025-project Sep 01 14:04:27.713219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:04:27.713219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:04:27.713219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 9c60f6eaccad440abff863fe99b40382 Sep 01 14:04:27.713219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-VolumesActionsTest-479162025-project Sep 01 14:04:27.713219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:04:27.713219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 could not be found. Sep 01 14:04:27.713219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58'} Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 could not be found. Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:04:27.714173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 could not be found. Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 could not be found. Sep 01 14:04:27.715994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:27.717078 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-994ab262-6b9e-4d36-ae25-19607d1bd427 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] Returning 404 to user: Instance 9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:04:27.717078 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-994ab262-6b9e-4d36-ae25-19607d1bd427 tempest-VolumesActionsTest-479162025 tempest-VolumesActionsTest-479162025-project] 10.222.0.61 "GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58" status: 404 len: 111 microversion: 2.1 time: 0.045549 Sep 01 14:04:27.717078 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 272/516] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:27 2022] GET /compute/v2.1/servers/9fa9b3d2-3ac1-4044-afd3-0d7fffd56f58 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:04:27.719063 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-895303ba-6a6b-4a6c-8e11-6c6ac79f63ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:27.719836 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-895303ba-6a6b-4a6c-8e11-6c6ac79f63ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:27.727759 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-895303ba-6a6b-4a6c-8e11-6c6ac79f63ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:27.728460 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-895303ba-6a6b-4a6c-8e11-6c6ac79f63ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:27.729052 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-895303ba-6a6b-4a6c-8e11-6c6ac79f63ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:27.729812 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-895303ba-6a6b-4a6c-8e11-6c6ac79f63ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:27.730274 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-895303ba-6a6b-4a6c-8e11-6c6ac79f63ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:27.730701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-895303ba-6a6b-4a6c-8e11-6c6ac79f63ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:27.914254 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.network.neutron [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] validate_networks() for [('241bed09-c819-467f-87d6-202417ebcf87', None, None, None, None, None)] {{(pid=127812) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:04:27.995217 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-895303ba-6a6b-4a6c-8e11-6c6ac79f63ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:28.003339 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-895303ba-6a6b-4a6c-8e11-6c6ac79f63ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1683 microversion: 2.1 time: 0.288133 Sep 01 14:04:28.007405 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 273/517] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:27 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1683 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:28.430559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0a557129-a38f-4e0d-b241-2b66240da31f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:28.431284 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0a557129-a38f-4e0d-b241-2b66240da31f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:28.439774 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0a557129-a38f-4e0d-b241-2b66240da31f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:28.440550 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0a557129-a38f-4e0d-b241-2b66240da31f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:28.440996 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0a557129-a38f-4e0d-b241-2b66240da31f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:28.441721 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0a557129-a38f-4e0d-b241-2b66240da31f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:28.442734 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0a557129-a38f-4e0d-b241-2b66240da31f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:28.443168 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0a557129-a38f-4e0d-b241-2b66240da31f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:28.870660 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0a557129-a38f-4e0d-b241-2b66240da31f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:28.892661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0a557129-a38f-4e0d-b241-2b66240da31f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1594 microversion: 2.1 time: 0.466004 Sep 01 14:04:28.893250 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 274/518] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:28 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1594 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:28.917149 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5571f59f-212b-4804-9495-2b9c7a151bdc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:28.917799 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-5571f59f-212b-4804-9495-2b9c7a151bdc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:28.924694 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5571f59f-212b-4804-9495-2b9c7a151bdc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:28.925589 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5571f59f-212b-4804-9495-2b9c7a151bdc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:28.927644 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5571f59f-212b-4804-9495-2b9c7a151bdc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:28.928677 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5571f59f-212b-4804-9495-2b9c7a151bdc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:28.929288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5571f59f-212b-4804-9495-2b9c7a151bdc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:28.929905 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5571f59f-212b-4804-9495-2b9c7a151bdc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:28.933061 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Flavor limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:04:28.935891 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Image limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:04:28.935891 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Flavor pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:04:28.935891 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Image pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:04:28.935891 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:04:28.948821 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:28.950044 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:28.950730 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:28.951858 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:28.952457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:28.954092 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:28.996352 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Getting quotas for project dce10589b8b240e6829f2e158415a1b8. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:04:29.007542 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Getting quotas for user 65c88d8b86544ab5825adbadb26b1e2e and project dce10589b8b240e6829f2e158415a1b8. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:04:29.026796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Going to run 1 instances... {{(pid=127812) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:04:29.030662 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:04:29.132483 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5571f59f-212b-4804-9495-2b9c7a151bdc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:29.155062 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-5571f59f-212b-4804-9495-2b9c7a151bdc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1677 microversion: 2.1 time: 0.243685 Sep 01 14:04:29.155517 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 275/519] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:28 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1677 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:29.160179 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-bd8ee76f-e4c5-4425-b509-bff3270fdafc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:29.161624 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-bd8ee76f-e4c5-4425-b509-bff3270fdafc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:29.179053 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bd8ee76f-e4c5-4425-b509-bff3270fdafc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:29.183875 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bd8ee76f-e4c5-4425-b509-bff3270fdafc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:29.183875 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bd8ee76f-e4c5-4425-b509-bff3270fdafc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:29.183875 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bd8ee76f-e4c5-4425-b509-bff3270fdafc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:29.183875 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bd8ee76f-e4c5-4425-b509-bff3270fdafc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:29.184246 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bd8ee76f-e4c5-4425-b509-bff3270fdafc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:29.222097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-00bb6cbf-bd1a-4d03-9d16-e4f6c1301e2e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.540695 Sep 01 14:04:29.223192 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 245/520] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:04:27 2022] POST /compute/v2.1/servers => generated 408 bytes in 1557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:04:29.242821 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-038aa031-9905-44f6-9f71-2ecebb763988 req-2fa53708-5389-4af7-a37a-6867b7400ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "237052f9-426e-430e-b59c-ffc2f03c9e11", "name": "network-vif-deleted", "tag": "0307fbc0-775a-451f-bec3-f5625a98c36f"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:29.259509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-038aa031-9905-44f6-9f71-2ecebb763988 req-2fa53708-5389-4af7-a37a-6867b7400ecd service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:29.260486 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-038aa031-9905-44f6-9f71-2ecebb763988 req-2fa53708-5389-4af7-a37a-6867b7400ecd service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:29.261290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-038aa031-9905-44f6-9f71-2ecebb763988 req-2fa53708-5389-4af7-a37a-6867b7400ecd service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:29.284635 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-038aa031-9905-44f6-9f71-2ecebb763988 req-2fa53708-5389-4af7-a37a-6867b7400ecd service nova] Creating event network-vif-deleted:0307fbc0-775a-451f-bec3-f5625a98c36f for instance 237052f9-426e-430e-b59c-ffc2f03c9e11 on hv-cinder-85221 Sep 01 14:04:29.298241 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-038aa031-9905-44f6-9f71-2ecebb763988 req-2fa53708-5389-4af7-a37a-6867b7400ecd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063631 Sep 01 14:04:29.300658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 246/521] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:29.313084 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:29.315350 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:29.349358 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:29.350901 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:29.351343 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:29.362652 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:29.363167 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:29.363643 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:29.461917 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:29.470251 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:29.470683 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:29.471532 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lazy-loading 'fault' on Instance uuid 237052f9-426e-430e-b59c-ffc2f03c9e11 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:29.494245 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-bd8ee76f-e4c5-4425-b509-bff3270fdafc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:29.504953 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-bd8ee76f-e4c5-4425-b509-bff3270fdafc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:29.523468 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-bd8ee76f-e4c5-4425-b509-bff3270fdafc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:29.524737 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-bd8ee76f-e4c5-4425-b509-bff3270fdafc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.368258 Sep 01 14:04:29.534597 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 276/522] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:29 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:29.559946 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a236c350-44d3-4a53-a1ed-24adbdde35d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:29.560583 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a236c350-44d3-4a53-a1ed-24adbdde35d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:29.608636 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:29.618472 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-11e34d32-6b66-4095-8ad7-f66b7811643e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1331 microversion: 2.1 time: 0.315153 Sep 01 14:04:29.619718 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 247/523] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:29 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1331 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:29.644998 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a236c350-44d3-4a53-a1ed-24adbdde35d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:29.653872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a236c350-44d3-4a53-a1ed-24adbdde35d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1244 microversion: 2.1 time: 0.116637 Sep 01 14:04:29.657453 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 277/524] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:29 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1244 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:29.955961 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-11ef8408-ab5b-45bf-b06e-9abdc91d4abb req-94cb7946-fc79-49ae-b4bb-b75425578665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bac5a33-d73f-48a4-bead-fcf039becf3a", "name": "network-vif-plugged", "status": "completed", "tag": "aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:29.971625 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-11ef8408-ab5b-45bf-b06e-9abdc91d4abb req-94cb7946-fc79-49ae-b4bb-b75425578665 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:29.972660 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-11ef8408-ab5b-45bf-b06e-9abdc91d4abb req-94cb7946-fc79-49ae-b4bb-b75425578665 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:29.974609 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-11ef8408-ab5b-45bf-b06e-9abdc91d4abb req-94cb7946-fc79-49ae-b4bb-b75425578665 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:29.991673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-11ef8408-ab5b-45bf-b06e-9abdc91d4abb req-94cb7946-fc79-49ae-b4bb-b75425578665 service nova] Creating event network-vif-plugged:aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025 for instance 0bac5a33-d73f-48a4-bead-fcf039becf3a on hv-cinder-85221 Sep 01 14:04:29.999913 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-11ef8408-ab5b-45bf-b06e-9abdc91d4abb req-94cb7946-fc79-49ae-b4bb-b75425578665 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050145 Sep 01 14:04:30.002084 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 248/525] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:30.188784 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d9ac1d5e-569d-47f4-81bb-fc83c44a00dd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:30.189404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d9ac1d5e-569d-47f4-81bb-fc83c44a00dd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:30.198352 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d9ac1d5e-569d-47f4-81bb-fc83c44a00dd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:30.199331 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d9ac1d5e-569d-47f4-81bb-fc83c44a00dd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:30.199834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d9ac1d5e-569d-47f4-81bb-fc83c44a00dd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:30.200550 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d9ac1d5e-569d-47f4-81bb-fc83c44a00dd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:30.201020 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d9ac1d5e-569d-47f4-81bb-fc83c44a00dd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:30.201447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d9ac1d5e-569d-47f4-81bb-fc83c44a00dd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:30.378414 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d9ac1d5e-569d-47f4-81bb-fc83c44a00dd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:30.388546 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d9ac1d5e-569d-47f4-81bb-fc83c44a00dd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1677 microversion: 2.1 time: 0.205196 Sep 01 14:04:30.389845 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 278/526] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:30 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:30.561108 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-cbf7de6c-8b7f-45bb-b7a1-133c08b58402 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:30.562041 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-cbf7de6c-8b7f-45bb-b7a1-133c08b58402 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:30.574492 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cbf7de6c-8b7f-45bb-b7a1-133c08b58402 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:30.575909 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cbf7de6c-8b7f-45bb-b7a1-133c08b58402 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:30.576478 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cbf7de6c-8b7f-45bb-b7a1-133c08b58402 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:30.577682 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cbf7de6c-8b7f-45bb-b7a1-133c08b58402 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:30.578173 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cbf7de6c-8b7f-45bb-b7a1-133c08b58402 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:30.579124 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cbf7de6c-8b7f-45bb-b7a1-133c08b58402 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:30.641601 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:30.642864 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:30.651200 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:30.651996 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:30.652424 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:30.653126 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:30.653571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:30.654016 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:30.689702 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:30.690219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:30.690796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:30.691146 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lazy-loading 'fault' on Instance uuid 237052f9-426e-430e-b59c-ffc2f03c9e11 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:30.747240 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:30.757040 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-05feff53-c834-47c4-91d1-33480100e192 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1331 microversion: 2.1 time: 0.119043 Sep 01 14:04:30.763030 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-cbf7de6c-8b7f-45bb-b7a1-133c08b58402 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:30.771881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 279/527] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:30 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1331 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:30.776202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-cbf7de6c-8b7f-45bb-b7a1-133c08b58402 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:30.777332 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7c585c32-8f05-4cf0-a8ad-41d7d322bb21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:30.778173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7c585c32-8f05-4cf0-a8ad-41d7d322bb21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:30.778550 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-cbf7de6c-8b7f-45bb-b7a1-133c08b58402 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:30.780242 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-cbf7de6c-8b7f-45bb-b7a1-133c08b58402 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.223289 Sep 01 14:04:30.781303 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 249/528] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:30 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:30.785078 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c585c32-8f05-4cf0-a8ad-41d7d322bb21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:30.785569 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c585c32-8f05-4cf0-a8ad-41d7d322bb21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:30.786097 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c585c32-8f05-4cf0-a8ad-41d7d322bb21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:30.786798 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c585c32-8f05-4cf0-a8ad-41d7d322bb21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:30.787248 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c585c32-8f05-4cf0-a8ad-41d7d322bb21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:30.787925 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c585c32-8f05-4cf0-a8ad-41d7d322bb21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:30.856060 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7c585c32-8f05-4cf0-a8ad-41d7d322bb21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:30.876082 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7c585c32-8f05-4cf0-a8ad-41d7d322bb21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1248 microversion: 2.1 time: 0.102923 Sep 01 14:04:30.876855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 280/529] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:30 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1248 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:31.413623 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-40f03db0-58fb-45b9-b37f-b3f9e20ee995 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:31.414424 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-40f03db0-58fb-45b9-b37f-b3f9e20ee995 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:31.420948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-40f03db0-58fb-45b9-b37f-b3f9e20ee995 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:31.421509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-40f03db0-58fb-45b9-b37f-b3f9e20ee995 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:31.422112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-40f03db0-58fb-45b9-b37f-b3f9e20ee995 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:31.422726 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-40f03db0-58fb-45b9-b37f-b3f9e20ee995 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:31.423185 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-40f03db0-58fb-45b9-b37f-b3f9e20ee995 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:31.423615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-40f03db0-58fb-45b9-b37f-b3f9e20ee995 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:31.562147 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-40f03db0-58fb-45b9-b37f-b3f9e20ee995 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:31.574055 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-40f03db0-58fb-45b9-b37f-b3f9e20ee995 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1677 microversion: 2.1 time: 0.164978 Sep 01 14:04:31.588356 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 250/530] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:31 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1677 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:31.782759 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:31.783419 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:31.791280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:31.791974 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:31.792403 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:31.793300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:31.793970 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:31.794551 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:31.803472 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e84a2367-f982-4ecc-99f7-38db8694049b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:31.803994 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e84a2367-f982-4ecc-99f7-38db8694049b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:31.817301 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e84a2367-f982-4ecc-99f7-38db8694049b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:31.817727 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e84a2367-f982-4ecc-99f7-38db8694049b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:31.825282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e84a2367-f982-4ecc-99f7-38db8694049b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:31.825282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e84a2367-f982-4ecc-99f7-38db8694049b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:31.825282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e84a2367-f982-4ecc-99f7-38db8694049b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:31.825282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e84a2367-f982-4ecc-99f7-38db8694049b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:31.828417 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:31.828914 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:31.829351 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:31.829831 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lazy-loading 'fault' on Instance uuid 237052f9-426e-430e-b59c-ffc2f03c9e11 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:31.892242 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:31.907368 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f35934f4-db11-4ded-b93d-1c540a869d06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1331 microversion: 2.1 time: 0.127910 Sep 01 14:04:31.909471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 281/531] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:31 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1331 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:31.925942 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c5e232ec-4e97-4f20-af9b-fbbff4529964 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:31.928207 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c5e232ec-4e97-4f20-af9b-fbbff4529964 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:31.937841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c5e232ec-4e97-4f20-af9b-fbbff4529964 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:31.938564 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c5e232ec-4e97-4f20-af9b-fbbff4529964 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:31.939202 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c5e232ec-4e97-4f20-af9b-fbbff4529964 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:31.940085 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c5e232ec-4e97-4f20-af9b-fbbff4529964 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:31.940549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c5e232ec-4e97-4f20-af9b-fbbff4529964 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:31.940970 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c5e232ec-4e97-4f20-af9b-fbbff4529964 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:31.991541 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e84a2367-f982-4ecc-99f7-38db8694049b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:32.001986 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e84a2367-f982-4ecc-99f7-38db8694049b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:32.003774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e84a2367-f982-4ecc-99f7-38db8694049b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:32.006060 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e84a2367-f982-4ecc-99f7-38db8694049b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.206575 Sep 01 14:04:32.007236 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 251/532] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:31 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:32.012297 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-24bad45e-ab25-4cf8-98ae-891a988d69cd req-217714d0-844a-4853-a0f6-48fc1b843646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d699cea-9245-405e-87bb-0c9e6af9391b", "tag": "095e75e8-b9ca-4c49-8292-9f9586ad794f"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:32.023598 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-24bad45e-ab25-4cf8-98ae-891a988d69cd req-217714d0-844a-4853-a0f6-48fc1b843646 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:32.024082 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-24bad45e-ab25-4cf8-98ae-891a988d69cd req-217714d0-844a-4853-a0f6-48fc1b843646 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:32.024514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-24bad45e-ab25-4cf8-98ae-891a988d69cd req-217714d0-844a-4853-a0f6-48fc1b843646 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:32.041235 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-24bad45e-ab25-4cf8-98ae-891a988d69cd req-217714d0-844a-4853-a0f6-48fc1b843646 service nova] Creating event network-changed:095e75e8-b9ca-4c49-8292-9f9586ad794f for instance 4d699cea-9245-405e-87bb-0c9e6af9391b on hv-cinder-85221 Sep 01 14:04:32.041457 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c5e232ec-4e97-4f20-af9b-fbbff4529964 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:32.043266 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-24bad45e-ab25-4cf8-98ae-891a988d69cd req-217714d0-844a-4853-a0f6-48fc1b843646 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034628 Sep 01 14:04:32.044247 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 252/533] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:32.053809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c5e232ec-4e97-4f20-af9b-fbbff4529964 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1248 microversion: 2.1 time: 0.142421 Sep 01 14:04:32.054740 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 282/534] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:31 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1248 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:32.599948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9debfd55-0d8a-4b87-9fa8-5d99dbb67705 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:32.600656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9debfd55-0d8a-4b87-9fa8-5d99dbb67705 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:32.607701 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9debfd55-0d8a-4b87-9fa8-5d99dbb67705 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:32.608194 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9debfd55-0d8a-4b87-9fa8-5d99dbb67705 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:32.608632 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9debfd55-0d8a-4b87-9fa8-5d99dbb67705 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:32.609340 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9debfd55-0d8a-4b87-9fa8-5d99dbb67705 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:32.609852 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9debfd55-0d8a-4b87-9fa8-5d99dbb67705 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:32.610271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9debfd55-0d8a-4b87-9fa8-5d99dbb67705 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:32.776632 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9debfd55-0d8a-4b87-9fa8-5d99dbb67705 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:32.785176 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9debfd55-0d8a-4b87-9fa8-5d99dbb67705 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1677 microversion: 2.1 time: 0.190052 Sep 01 14:04:32.785803 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 253/535] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:32 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:32.929069 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:32.930680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:32.937869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:32.938375 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:32.938872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:32.939598 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:32.940063 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:32.940546 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:32.978515 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:32.979014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:32.979452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:32.980095 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lazy-loading 'fault' on Instance uuid 237052f9-426e-430e-b59c-ffc2f03c9e11 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:33.025030 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:33.033668 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1846fc43-4916-42b1-8153-666623146359 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1331 microversion: 2.1 time: 0.108686 Sep 01 14:04:33.034527 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 283/536] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:32 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:33.050363 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-fb58f98c-84db-4384-86de-2915e4914a5d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:33.055077 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fb58f98c-84db-4384-86de-2915e4914a5d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:33.057580 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb58f98c-84db-4384-86de-2915e4914a5d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:33.058119 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb58f98c-84db-4384-86de-2915e4914a5d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:33.058562 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb58f98c-84db-4384-86de-2915e4914a5d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:33.059275 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb58f98c-84db-4384-86de-2915e4914a5d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:33.059732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb58f98c-84db-4384-86de-2915e4914a5d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:33.060158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb58f98c-84db-4384-86de-2915e4914a5d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:33.076575 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3d1095c8-6ce5-4a23-9423-d9ce702f5ab0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:33.077298 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3d1095c8-6ce5-4a23-9423-d9ce702f5ab0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:33.086971 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3d1095c8-6ce5-4a23-9423-d9ce702f5ab0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:33.087660 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3d1095c8-6ce5-4a23-9423-d9ce702f5ab0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:33.089432 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3d1095c8-6ce5-4a23-9423-d9ce702f5ab0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:33.089432 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3d1095c8-6ce5-4a23-9423-d9ce702f5ab0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:33.089955 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3d1095c8-6ce5-4a23-9423-d9ce702f5ab0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:33.090455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3d1095c8-6ce5-4a23-9423-d9ce702f5ab0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:33.193196 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3d1095c8-6ce5-4a23-9423-d9ce702f5ab0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:33.204845 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3d1095c8-6ce5-4a23-9423-d9ce702f5ab0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1248 microversion: 2.1 time: 0.133293 Sep 01 14:04:33.205459 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 284/537] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:33 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1248 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:33.249566 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fb58f98c-84db-4384-86de-2915e4914a5d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:33.260303 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fb58f98c-84db-4384-86de-2915e4914a5d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:33.264592 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fb58f98c-84db-4384-86de-2915e4914a5d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:33.264592 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-fb58f98c-84db-4384-86de-2915e4914a5d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.218192 Sep 01 14:04:33.264592 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 254/538] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:33 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:33.807226 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-35056d96-42d4-4f9e-acb6-7266bfccf7e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:33.807856 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-35056d96-42d4-4f9e-acb6-7266bfccf7e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:33.813968 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-35056d96-42d4-4f9e-acb6-7266bfccf7e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:33.814490 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-35056d96-42d4-4f9e-acb6-7266bfccf7e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:33.814926 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-35056d96-42d4-4f9e-acb6-7266bfccf7e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:33.815622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-35056d96-42d4-4f9e-acb6-7266bfccf7e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:33.816077 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-35056d96-42d4-4f9e-acb6-7266bfccf7e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:33.816495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-35056d96-42d4-4f9e-acb6-7266bfccf7e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:34.036793 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-35056d96-42d4-4f9e-acb6-7266bfccf7e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:34.047858 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-35056d96-42d4-4f9e-acb6-7266bfccf7e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1677 microversion: 2.1 time: 0.244359 Sep 01 14:04:34.048806 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 285/539] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:33 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1677 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:34.062825 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:34.062825 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:34.063404 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:34.063893 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:34.064977 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:34.065891 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:34.066621 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:34.067091 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:34.103557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:34.104029 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:34.104465 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:34.104934 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lazy-loading 'fault' on Instance uuid 237052f9-426e-430e-b59c-ffc2f03c9e11 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:34.179091 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:34.187264 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-efb175c0-de12-4532-b420-7cd0470cee63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 200 len: 1331 microversion: 2.1 time: 0.136435 Sep 01 14:04:34.204154 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 255/540] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:34 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 1331 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:34.232345 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d1e1200b-df31-4e33-84f2-514669b287e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:34.233337 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d1e1200b-df31-4e33-84f2-514669b287e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:34.241173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1e1200b-df31-4e33-84f2-514669b287e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:34.241786 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1e1200b-df31-4e33-84f2-514669b287e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:34.242337 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1e1200b-df31-4e33-84f2-514669b287e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:34.243207 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1e1200b-df31-4e33-84f2-514669b287e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:34.243941 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1e1200b-df31-4e33-84f2-514669b287e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:34.244486 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1e1200b-df31-4e33-84f2-514669b287e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:34.293927 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-97be64a4-58e6-43b4-bff9-92054c7089c5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:34.297806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-97be64a4-58e6-43b4-bff9-92054c7089c5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:34.310128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:34.323146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-97be64a4-58e6-43b4-bff9-92054c7089c5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:34.329479 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-97be64a4-58e6-43b4-bff9-92054c7089c5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:34.329479 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-97be64a4-58e6-43b4-bff9-92054c7089c5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:34.329479 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-97be64a4-58e6-43b4-bff9-92054c7089c5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:34.330366 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-97be64a4-58e6-43b4-bff9-92054c7089c5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:34.330486 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-97be64a4-58e6-43b4-bff9-92054c7089c5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:34.425213 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d1e1200b-df31-4e33-84f2-514669b287e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:34.434709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d1e1200b-df31-4e33-84f2-514669b287e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1296 microversion: 2.1 time: 0.209541 Sep 01 14:04:34.441651 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 286/541] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:34 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1296 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:34.543790 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-97be64a4-58e6-43b4-bff9-92054c7089c5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:34.553626 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-97be64a4-58e6-43b4-bff9-92054c7089c5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:34.556848 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-97be64a4-58e6-43b4-bff9-92054c7089c5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:34.556848 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-97be64a4-58e6-43b4-bff9-92054c7089c5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.273575 Sep 01 14:04:34.557177 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 256/542] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:34 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:35.072909 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f07dbfe5-e9fb-4f38-8ccf-4b9dc88ebd8e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:35.074597 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f07dbfe5-e9fb-4f38-8ccf-4b9dc88ebd8e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:35.083253 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f07dbfe5-e9fb-4f38-8ccf-4b9dc88ebd8e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:35.086201 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f07dbfe5-e9fb-4f38-8ccf-4b9dc88ebd8e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:35.086961 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f07dbfe5-e9fb-4f38-8ccf-4b9dc88ebd8e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:35.087944 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f07dbfe5-e9fb-4f38-8ccf-4b9dc88ebd8e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:35.088643 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f07dbfe5-e9fb-4f38-8ccf-4b9dc88ebd8e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:35.089290 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f07dbfe5-e9fb-4f38-8ccf-4b9dc88ebd8e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:35.111018 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:35.227665 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-83664a6d-92a2-438e-9ee3-6df1d7bc5a4c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:35.230077 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-83664a6d-92a2-438e-9ee3-6df1d7bc5a4c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:35.285089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-83664a6d-92a2-438e-9ee3-6df1d7bc5a4c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:35.304379 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-83664a6d-92a2-438e-9ee3-6df1d7bc5a4c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:35.305238 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-83664a6d-92a2-438e-9ee3-6df1d7bc5a4c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:35.319680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-83664a6d-92a2-438e-9ee3-6df1d7bc5a4c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:35.324850 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-83664a6d-92a2-438e-9ee3-6df1d7bc5a4c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:35.326245 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-83664a6d-92a2-438e-9ee3-6df1d7bc5a4c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-83664a6d-92a2-438e-9ee3-6df1d7bc5a4c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-83664a6d-92a2-438e-9ee3-6df1d7bc5a4c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 HTTP/1.1 Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:04:35.419604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:04:35.421422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:04:35.421422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:04:35.421422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:04:35.421422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:04:35.421422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:04:35.421422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:04:35.421422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:04:35.421422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:04:35.421422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:04:35.421422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:04:35.421422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:04:35.421422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '237052f9-426e-430e-b59c-ffc2f03c9e11'} Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:04:35.423179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:04:35.425944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:04:35.429880 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-83664a6d-92a2-438e-9ee3-6df1d7bc5a4c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 404 to user: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:04:35.429880 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-83664a6d-92a2-438e-9ee3-6df1d7bc5a4c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 404 len: 111 microversion: 2.1 time: 0.175419 Sep 01 14:04:35.429880 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 257/543] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:35 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:04:35.434079 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f07dbfe5-e9fb-4f38-8ccf-4b9dc88ebd8e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:35.436549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f07dbfe5-e9fb-4f38-8ccf-4b9dc88ebd8e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1677 microversion: 2.1 time: 0.367671 Sep 01 14:04:35.436892 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-57365b9b-1c2a-405b-b695-9ce9097cb464 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '.version_select at 0x7f1afd308790>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:35.437140 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 287/544] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:35 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1677 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:35.474177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-610cbb5b-b1e4-44b1-b457-98b1864017fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:35.474871 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-610cbb5b-b1e4-44b1-b457-98b1864017fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:35.491856 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-610cbb5b-b1e4-44b1-b457-98b1864017fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:35.492616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-610cbb5b-b1e4-44b1-b457-98b1864017fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:35.493791 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-610cbb5b-b1e4-44b1-b457-98b1864017fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:35.494715 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-610cbb5b-b1e4-44b1-b457-98b1864017fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:35.496423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-610cbb5b-b1e4-44b1-b457-98b1864017fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:35.497863 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-610cbb5b-b1e4-44b1-b457-98b1864017fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:35.565804 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-57365b9b-1c2a-405b-b695-9ce9097cb464 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1686692386" status: 202 len: 0 microversion: 2.1 time: 0.141784 Sep 01 14:04:35.570262 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 258/545] 10.222.0.61 () {58 vars in 1221 bytes} [Thu Sep 1 14:04:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1686692386 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:04:35.585392 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-610cbb5b-b1e4-44b1-b457-98b1864017fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:35.595668 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-40df2e8b-7e6a-436a-9b61-4611ecddc976 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:35.604035 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-40df2e8b-7e6a-436a-9b61-4611ecddc976 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:35.606910 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-610cbb5b-b1e4-44b1-b457-98b1864017fc tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1296 microversion: 2.1 time: 0.148271 Sep 01 14:04:35.611299 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 288/546] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:35 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1296 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:35.623310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a5b66251-dc04-4881-a409-0e3c9e738740 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-873904408"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:35.624475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a5b66251-dc04-4881-a409-0e3c9e738740 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:35.624927 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-40df2e8b-7e6a-436a-9b61-4611ecddc976 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:35.625543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-40df2e8b-7e6a-436a-9b61-4611ecddc976 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:35.626091 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-40df2e8b-7e6a-436a-9b61-4611ecddc976 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:35.626905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-40df2e8b-7e6a-436a-9b61-4611ecddc976 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:35.627660 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-40df2e8b-7e6a-436a-9b61-4611ecddc976 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:35.628350 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-40df2e8b-7e6a-436a-9b61-4611ecddc976 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:35.634012 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a5b66251-dc04-4881-a409-0e3c9e738740 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:35.636786 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a5b66251-dc04-4881-a409-0e3c9e738740 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:35.637629 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a5b66251-dc04-4881-a409-0e3c9e738740 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:35.638704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a5b66251-dc04-4881-a409-0e3c9e738740 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:35.640697 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a5b66251-dc04-4881-a409-0e3c9e738740 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:35.641474 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a5b66251-dc04-4881-a409-0e3c9e738740 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:35.942187 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-40df2e8b-7e6a-436a-9b61-4611ecddc976 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:35.956986 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-40df2e8b-7e6a-436a-9b61-4611ecddc976 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:35.959647 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-40df2e8b-7e6a-436a-9b61-4611ecddc976 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:35.961990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-40df2e8b-7e6a-436a-9b61-4611ecddc976 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.382208 Sep 01 14:04:35.988254 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 259/547] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:35 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:35.995862 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.network.security_group_api [None req-a5b66251-dc04-4881-a409-0e3c9e738740 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Adding security group b58b42ff-324a-40fc-9c5c-a37b4f1bd914 to port 095e75e8-b9ca-4c49-8292-9f9586ad794f Sep 01 14:04:36.470153 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4db6f58d-954c-4489-9346-bd5acd4938b9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:36.471427 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4db6f58d-954c-4489-9346-bd5acd4938b9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:36.483280 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4db6f58d-954c-4489-9346-bd5acd4938b9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:36.486243 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4db6f58d-954c-4489-9346-bd5acd4938b9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:36.486960 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4db6f58d-954c-4489-9346-bd5acd4938b9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:36.490427 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4db6f58d-954c-4489-9346-bd5acd4938b9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:36.490971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4db6f58d-954c-4489-9346-bd5acd4938b9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:36.491416 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4db6f58d-954c-4489-9346-bd5acd4938b9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:36.498096 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:36.664154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a5b66251-dc04-4881-a409-0e3c9e738740 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "POST /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/action" status: 202 len: 0 microversion: 2.1 time: 1.045909 Sep 01 14:04:36.665247 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 289/548] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:04:35 2022] POST /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/action => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:04:36.680376 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cef2e652-9bd4-42ad-9d81-bf1fdac19b9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:36.680376 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-cef2e652-9bd4-42ad-9d81-bf1fdac19b9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:36.707374 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cef2e652-9bd4-42ad-9d81-bf1fdac19b9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:36.708504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cef2e652-9bd4-42ad-9d81-bf1fdac19b9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:36.709002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cef2e652-9bd4-42ad-9d81-bf1fdac19b9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:36.712313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cef2e652-9bd4-42ad-9d81-bf1fdac19b9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:36.712567 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cef2e652-9bd4-42ad-9d81-bf1fdac19b9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:36.713047 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cef2e652-9bd4-42ad-9d81-bf1fdac19b9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:36.944662 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cef2e652-9bd4-42ad-9d81-bf1fdac19b9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:36.954407 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cef2e652-9bd4-42ad-9d81-bf1fdac19b9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1296 microversion: 2.1 time: 0.287894 Sep 01 14:04:36.954616 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4db6f58d-954c-4489-9346-bd5acd4938b9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:36.954998 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 290/549] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:36 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1296 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:36.966604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4db6f58d-954c-4489-9346-bd5acd4938b9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1677 microversion: 2.1 time: 0.504072 Sep 01 14:04:36.970605 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 260/550] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:36 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1677 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:36.986212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-a77d3e32-88bd-487b-bcf8-1c52f8af1efe req-5564e88d-7aad-48f8-86c8-a2924c85945b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d699cea-9245-405e-87bb-0c9e6af9391b", "tag": "095e75e8-b9ca-4c49-8292-9f9586ad794f"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:36.989814 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a29587ae-836f-4cd6-b6d3-87a52cd17a85 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:36.992957 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a29587ae-836f-4cd6-b6d3-87a52cd17a85 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:37.005063 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a29587ae-836f-4cd6-b6d3-87a52cd17a85 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:37.006263 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a29587ae-836f-4cd6-b6d3-87a52cd17a85 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:37.006991 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a29587ae-836f-4cd6-b6d3-87a52cd17a85 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:37.007935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a29587ae-836f-4cd6-b6d3-87a52cd17a85 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:37.008462 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a29587ae-836f-4cd6-b6d3-87a52cd17a85 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:37.008960 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a29587ae-836f-4cd6-b6d3-87a52cd17a85 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:37.029976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-a77d3e32-88bd-487b-bcf8-1c52f8af1efe req-5564e88d-7aad-48f8-86c8-a2924c85945b service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:37.030464 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-a77d3e32-88bd-487b-bcf8-1c52f8af1efe req-5564e88d-7aad-48f8-86c8-a2924c85945b service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:37.030960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-a77d3e32-88bd-487b-bcf8-1c52f8af1efe req-5564e88d-7aad-48f8-86c8-a2924c85945b service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:37.080096 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-a77d3e32-88bd-487b-bcf8-1c52f8af1efe req-5564e88d-7aad-48f8-86c8-a2924c85945b service nova] Creating event network-changed:095e75e8-b9ca-4c49-8292-9f9586ad794f for instance 4d699cea-9245-405e-87bb-0c9e6af9391b on hv-cinder-85221 Sep 01 14:04:37.093079 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-a77d3e32-88bd-487b-bcf8-1c52f8af1efe req-5564e88d-7aad-48f8-86c8-a2924c85945b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110355 Sep 01 14:04:37.101438 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 291/551] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:37.108352 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a3124cb0-7445-45d3-a685-379034c8fe81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:37.121807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a3124cb0-7445-45d3-a685-379034c8fe81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:37.139777 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a3124cb0-7445-45d3-a685-379034c8fe81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:37.142279 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a3124cb0-7445-45d3-a685-379034c8fe81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:37.144459 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a3124cb0-7445-45d3-a685-379034c8fe81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:37.145319 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a3124cb0-7445-45d3-a685-379034c8fe81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:37.150988 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a3124cb0-7445-45d3-a685-379034c8fe81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:37.151624 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a3124cb0-7445-45d3-a685-379034c8fe81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:37.521504 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a29587ae-836f-4cd6-b6d3-87a52cd17a85 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:37.523696 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a29587ae-836f-4cd6-b6d3-87a52cd17a85 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1758 microversion: 2.1 time: 0.542898 Sep 01 14:04:37.527057 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 261/552] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:36 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1758 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:37.537055 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1e7bb2bb-37cf-402b-8685-9febb6480591 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:37.540278 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1e7bb2bb-37cf-402b-8685-9febb6480591 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:37.561505 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1e7bb2bb-37cf-402b-8685-9febb6480591 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:37.562419 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1e7bb2bb-37cf-402b-8685-9febb6480591 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:37.563092 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1e7bb2bb-37cf-402b-8685-9febb6480591 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:37.564047 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1e7bb2bb-37cf-402b-8685-9febb6480591 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:37.564774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1e7bb2bb-37cf-402b-8685-9febb6480591 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:37.565435 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1e7bb2bb-37cf-402b-8685-9febb6480591 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:37.702833 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a3124cb0-7445-45d3-a685-379034c8fe81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:37.715880 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a3124cb0-7445-45d3-a685-379034c8fe81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:37.717331 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a3124cb0-7445-45d3-a685-379034c8fe81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:37.723745 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a3124cb0-7445-45d3-a685-379034c8fe81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.619102 Sep 01 14:04:37.733026 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 292/553] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:37 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:37.833105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-1e7bb2bb-37cf-402b-8685-9febb6480591 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lazy-loading 'services' on Instance uuid 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:37.981630 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e63d4592-8f16-40de-99c6-30271c1c357f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:37.983337 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e63d4592-8f16-40de-99c6-30271c1c357f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:37.996081 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e63d4592-8f16-40de-99c6-30271c1c357f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:37.996081 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e63d4592-8f16-40de-99c6-30271c1c357f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:37.996081 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e63d4592-8f16-40de-99c6-30271c1c357f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:37.996726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e63d4592-8f16-40de-99c6-30271c1c357f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:37.997415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e63d4592-8f16-40de-99c6-30271c1c357f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:37.998333 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e63d4592-8f16-40de-99c6-30271c1c357f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:38.197598 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e63d4592-8f16-40de-99c6-30271c1c357f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:38.210432 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e63d4592-8f16-40de-99c6-30271c1c357f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1314 microversion: 2.1 time: 0.233624 Sep 01 14:04:38.212243 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 293/554] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:37 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:38.218860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-302da0b0-e253-4dec-858c-b92670ea83c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:38.221399 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-302da0b0-e253-4dec-858c-b92670ea83c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:38.228499 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-302da0b0-e253-4dec-858c-b92670ea83c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:38.229388 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-302da0b0-e253-4dec-858c-b92670ea83c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:38.237812 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-302da0b0-e253-4dec-858c-b92670ea83c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:38.237812 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-302da0b0-e253-4dec-858c-b92670ea83c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:38.237812 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-302da0b0-e253-4dec-858c-b92670ea83c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:38.237812 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-302da0b0-e253-4dec-858c-b92670ea83c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:38.464328 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1e7bb2bb-37cf-402b-8685-9febb6480591 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments/164d3bed-2366-46d9-a136-3778741c0854" status: 202 len: 0 microversion: 2.1 time: 0.935468 Sep 01 14:04:38.465306 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 262/555] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 1 14:04:37 2022] DELETE /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments/164d3bed-2366-46d9-a136-3778741c0854 => generated 0 bytes in 937 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:04:38.478179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-fbdd1567-702f-4777-8824-5fe14896c10f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:38.480837 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fbdd1567-702f-4777-8824-5fe14896c10f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:38.502263 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fbdd1567-702f-4777-8824-5fe14896c10f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:38.503083 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fbdd1567-702f-4777-8824-5fe14896c10f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:38.503768 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fbdd1567-702f-4777-8824-5fe14896c10f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:38.504756 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fbdd1567-702f-4777-8824-5fe14896c10f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:38.505385 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fbdd1567-702f-4777-8824-5fe14896c10f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:38.506537 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fbdd1567-702f-4777-8824-5fe14896c10f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:38.548680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-fbdd1567-702f-4777-8824-5fe14896c10f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078387 Sep 01 14:04:38.554561 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 263/556] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:04:38 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:38.764190 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d24f1849-cddb-4be1-82d2-b660fe8b1f45 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:38.770296 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d24f1849-cddb-4be1-82d2-b660fe8b1f45 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:38.807096 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d24f1849-cddb-4be1-82d2-b660fe8b1f45 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:38.820247 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d24f1849-cddb-4be1-82d2-b660fe8b1f45 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:38.822602 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d24f1849-cddb-4be1-82d2-b660fe8b1f45 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:38.830455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d24f1849-cddb-4be1-82d2-b660fe8b1f45 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:38.836263 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d24f1849-cddb-4be1-82d2-b660fe8b1f45 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:38.837401 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d24f1849-cddb-4be1-82d2-b660fe8b1f45 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:38.966330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:39.017229 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=10 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:39.034376 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-302da0b0-e253-4dec-858c-b92670ea83c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:39.053861 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-302da0b0-e253-4dec-858c-b92670ea83c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1654 microversion: 2.1 time: 0.839626 Sep 01 14:04:39.056139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 294/557] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:38 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1654 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:39.111095 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e41b16bf-fc03-474c-a18d-a1d162bf1db5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:39.118809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e41b16bf-fc03-474c-a18d-a1d162bf1db5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:39.119789 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e41b16bf-fc03-474c-a18d-a1d162bf1db5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:39.120466 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e41b16bf-fc03-474c-a18d-a1d162bf1db5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:39.149450 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e41b16bf-fc03-474c-a18d-a1d162bf1db5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Going to try to start instance {{(pid=127811) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 14:04:39.256553 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d24f1849-cddb-4be1-82d2-b660fe8b1f45 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:39.265545 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d24f1849-cddb-4be1-82d2-b660fe8b1f45 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:39.267064 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d24f1849-cddb-4be1-82d2-b660fe8b1f45 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:39.274377 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d24f1849-cddb-4be1-82d2-b660fe8b1f45 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.520483 Sep 01 14:04:39.274377 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 264/558] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:38 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:39.279078 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-58b78679-6262-48a6-9c91-c23df1dc4355 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:39.279078 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-58b78679-6262-48a6-9c91-c23df1dc4355 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:39.290165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-58b78679-6262-48a6-9c91-c23df1dc4355 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:39.291161 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-58b78679-6262-48a6-9c91-c23df1dc4355 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:39.291970 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-58b78679-6262-48a6-9c91-c23df1dc4355 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:39.293284 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-58b78679-6262-48a6-9c91-c23df1dc4355 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:39.294173 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-58b78679-6262-48a6-9c91-c23df1dc4355 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:39.295025 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-58b78679-6262-48a6-9c91-c23df1dc4355 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:39.410429 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-58b78679-6262-48a6-9c91-c23df1dc4355 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:39.424254 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-58b78679-6262-48a6-9c91-c23df1dc4355 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1302 microversion: 2.1 time: 0.153642 Sep 01 14:04:39.425899 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 265/559] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:39 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1302 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:39.556628 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e41b16bf-fc03-474c-a18d-a1d162bf1db5 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "POST /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/action" status: 202 len: 0 microversion: 2.1 time: 0.450033 Sep 01 14:04:39.556628 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 295/560] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:04:39 2022] POST /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:04:39.564952 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-345be7ec-1785-4868-8705-c84aa041c0ae tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:39.568563 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-345be7ec-1785-4868-8705-c84aa041c0ae tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:39.572266 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0b05af03-d6d2-421d-9c9b-fec24db57489 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:39.573846 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0b05af03-d6d2-421d-9c9b-fec24db57489 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:39.577626 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-345be7ec-1785-4868-8705-c84aa041c0ae tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:39.579234 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-345be7ec-1785-4868-8705-c84aa041c0ae tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:39.579989 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-345be7ec-1785-4868-8705-c84aa041c0ae tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:39.580914 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-345be7ec-1785-4868-8705-c84aa041c0ae tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:39.581941 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-345be7ec-1785-4868-8705-c84aa041c0ae tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:39.582629 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-345be7ec-1785-4868-8705-c84aa041c0ae tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:39.584362 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0b05af03-d6d2-421d-9c9b-fec24db57489 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:39.585072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0b05af03-d6d2-421d-9c9b-fec24db57489 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:39.585670 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0b05af03-d6d2-421d-9c9b-fec24db57489 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:39.586445 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0b05af03-d6d2-421d-9c9b-fec24db57489 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:39.586995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0b05af03-d6d2-421d-9c9b-fec24db57489 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:39.587460 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0b05af03-d6d2-421d-9c9b-fec24db57489 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:39.626310 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-345be7ec-1785-4868-8705-c84aa041c0ae tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065702 Sep 01 14:04:39.638246 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 266/561] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:04:39 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:39.653006 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:39.923383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0b05af03-d6d2-421d-9c9b-fec24db57489 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:39.931592 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0b05af03-d6d2-421d-9c9b-fec24db57489 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1663 microversion: 2.1 time: 0.369153 Sep 01 14:04:39.937139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 296/562] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:39 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1663 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:40.296060 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7b5a16e6-aa0e-44da-9b2b-12e56754e8e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:40.298362 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7b5a16e6-aa0e-44da-9b2b-12e56754e8e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:40.310461 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7b5a16e6-aa0e-44da-9b2b-12e56754e8e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:40.312388 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7b5a16e6-aa0e-44da-9b2b-12e56754e8e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:40.313030 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7b5a16e6-aa0e-44da-9b2b-12e56754e8e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:40.323327 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7b5a16e6-aa0e-44da-9b2b-12e56754e8e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:40.324197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7b5a16e6-aa0e-44da-9b2b-12e56754e8e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:40.325029 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7b5a16e6-aa0e-44da-9b2b-12e56754e8e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:40.463056 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-461c5dc1-c575-4348-9cba-c08d810cc5ce tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:40.464614 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-461c5dc1-c575-4348-9cba-c08d810cc5ce tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:40.472955 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-461c5dc1-c575-4348-9cba-c08d810cc5ce tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:40.479370 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-461c5dc1-c575-4348-9cba-c08d810cc5ce tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:40.480969 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-461c5dc1-c575-4348-9cba-c08d810cc5ce tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:40.482971 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-461c5dc1-c575-4348-9cba-c08d810cc5ce tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:40.484715 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-461c5dc1-c575-4348-9cba-c08d810cc5ce tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:40.488480 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-461c5dc1-c575-4348-9cba-c08d810cc5ce tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:40.494398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7b5a16e6-aa0e-44da-9b2b-12e56754e8e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:40.505275 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7b5a16e6-aa0e-44da-9b2b-12e56754e8e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:40.506699 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7b5a16e6-aa0e-44da-9b2b-12e56754e8e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:40.508081 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7b5a16e6-aa0e-44da-9b2b-12e56754e8e1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.218306 Sep 01 14:04:40.508654 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 267/563] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:40 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:40.640311 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-be76c1ae-837a-4226-b34f-0e5c7ab01a63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:40.643669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-be76c1ae-837a-4226-b34f-0e5c7ab01a63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:40.657330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be76c1ae-837a-4226-b34f-0e5c7ab01a63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:40.658892 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be76c1ae-837a-4226-b34f-0e5c7ab01a63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:40.660135 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be76c1ae-837a-4226-b34f-0e5c7ab01a63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:40.662625 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be76c1ae-837a-4226-b34f-0e5c7ab01a63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:40.663443 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be76c1ae-837a-4226-b34f-0e5c7ab01a63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:40.664378 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be76c1ae-837a-4226-b34f-0e5c7ab01a63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:40.680916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-461c5dc1-c575-4348-9cba-c08d810cc5ce tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:40.691480 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-461c5dc1-c575-4348-9cba-c08d810cc5ce tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.240478 Sep 01 14:04:40.692522 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 297/564] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:40 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:40.710583 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-be76c1ae-837a-4226-b34f-0e5c7ab01a63 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074471 Sep 01 14:04:40.712294 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 268/565] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:04:40 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:04:40.956776 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-84454a14-7c08-4366-a3c8-2e2dbbd1a9d3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:40.957306 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-84454a14-7c08-4366-a3c8-2e2dbbd1a9d3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:40.968663 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-84454a14-7c08-4366-a3c8-2e2dbbd1a9d3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:40.969472 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-84454a14-7c08-4366-a3c8-2e2dbbd1a9d3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:40.970350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-84454a14-7c08-4366-a3c8-2e2dbbd1a9d3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:40.971191 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-84454a14-7c08-4366-a3c8-2e2dbbd1a9d3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:40.971791 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-84454a14-7c08-4366-a3c8-2e2dbbd1a9d3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:40.972356 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-84454a14-7c08-4366-a3c8-2e2dbbd1a9d3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:41.139390 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-84454a14-7c08-4366-a3c8-2e2dbbd1a9d3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:41.149675 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-84454a14-7c08-4366-a3c8-2e2dbbd1a9d3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1663 microversion: 2.1 time: 0.196950 Sep 01 14:04:41.150591 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 298/566] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:40 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1663 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:41.534937 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-988c3ef4-00a3-4f9c-9cbb-5e5c03d74f82 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:41.536099 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-988c3ef4-00a3-4f9c-9cbb-5e5c03d74f82 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:41.542970 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-988c3ef4-00a3-4f9c-9cbb-5e5c03d74f82 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:41.543801 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-988c3ef4-00a3-4f9c-9cbb-5e5c03d74f82 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:41.544681 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-988c3ef4-00a3-4f9c-9cbb-5e5c03d74f82 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:41.545649 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-988c3ef4-00a3-4f9c-9cbb-5e5c03d74f82 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:41.546228 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-988c3ef4-00a3-4f9c-9cbb-5e5c03d74f82 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:41.546875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-988c3ef4-00a3-4f9c-9cbb-5e5c03d74f82 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:41.702466 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-988c3ef4-00a3-4f9c-9cbb-5e5c03d74f82 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:41.712783 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8ba783de-53a3-43c6-a28a-1393627141be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:41.714105 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8ba783de-53a3-43c6-a28a-1393627141be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:41.724196 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-988c3ef4-00a3-4f9c-9cbb-5e5c03d74f82 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:41.728803 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-988c3ef4-00a3-4f9c-9cbb-5e5c03d74f82 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:41.730146 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8ba783de-53a3-43c6-a28a-1393627141be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:41.730410 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-988c3ef4-00a3-4f9c-9cbb-5e5c03d74f82 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.199509 Sep 01 14:04:41.743704 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 269/567] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:41 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:04:41.745628 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8ba783de-53a3-43c6-a28a-1393627141be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:41.746390 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8ba783de-53a3-43c6-a28a-1393627141be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:41.747726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8ba783de-53a3-43c6-a28a-1393627141be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:41.748756 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8ba783de-53a3-43c6-a28a-1393627141be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:41.749831 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8ba783de-53a3-43c6-a28a-1393627141be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:41.749964 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-25b3b873-8c07-43ce-a112-548566cba33b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:41.752659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-25b3b873-8c07-43ce-a112-548566cba33b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:41.759595 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-25b3b873-8c07-43ce-a112-548566cba33b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:41.760417 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-25b3b873-8c07-43ce-a112-548566cba33b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:41.761070 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-25b3b873-8c07-43ce-a112-548566cba33b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:41.762151 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-25b3b873-8c07-43ce-a112-548566cba33b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:41.762820 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-25b3b873-8c07-43ce-a112-548566cba33b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:41.763448 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-25b3b873-8c07-43ce-a112-548566cba33b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:41.801216 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-25b3b873-8c07-43ce-a112-548566cba33b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068954 Sep 01 14:04:41.802725 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 270/568] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:04:41 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:41.908931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-8ba783de-53a3-43c6-a28a-1393627141be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:41.917802 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8ba783de-53a3-43c6-a28a-1393627141be tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.208826 Sep 01 14:04:41.918440 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 299/569] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:41 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:42.173510 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0fda0257-57ef-4093-8648-0b2e7d299033 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:42.174273 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0fda0257-57ef-4093-8648-0b2e7d299033 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:42.181037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0fda0257-57ef-4093-8648-0b2e7d299033 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:42.182537 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0fda0257-57ef-4093-8648-0b2e7d299033 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:42.182537 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0fda0257-57ef-4093-8648-0b2e7d299033 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:42.182894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0fda0257-57ef-4093-8648-0b2e7d299033 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:42.183468 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0fda0257-57ef-4093-8648-0b2e7d299033 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:42.184102 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0fda0257-57ef-4093-8648-0b2e7d299033 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:42.330964 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0fda0257-57ef-4093-8648-0b2e7d299033 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:42.340112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0fda0257-57ef-4093-8648-0b2e7d299033 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1663 microversion: 2.1 time: 0.171028 Sep 01 14:04:42.340694 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 271/570] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:42 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:42.759425 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5ec09d81-9f6a-46e4-bf01-208b454c7dc8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:42.760033 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-5ec09d81-9f6a-46e4-bf01-208b454c7dc8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:42.767221 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ec09d81-9f6a-46e4-bf01-208b454c7dc8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:42.767988 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ec09d81-9f6a-46e4-bf01-208b454c7dc8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:42.768417 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ec09d81-9f6a-46e4-bf01-208b454c7dc8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:42.769115 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ec09d81-9f6a-46e4-bf01-208b454c7dc8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:42.769756 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ec09d81-9f6a-46e4-bf01-208b454c7dc8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:42.771935 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ec09d81-9f6a-46e4-bf01-208b454c7dc8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:42.829362 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d1360dfa-b2a8-4a0d-b269-b8da6198a1f4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:42.837126 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d1360dfa-b2a8-4a0d-b269-b8da6198a1f4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:42.848521 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d1360dfa-b2a8-4a0d-b269-b8da6198a1f4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:42.849335 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d1360dfa-b2a8-4a0d-b269-b8da6198a1f4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:42.849990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d1360dfa-b2a8-4a0d-b269-b8da6198a1f4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:42.851875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d1360dfa-b2a8-4a0d-b269-b8da6198a1f4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:42.852543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d1360dfa-b2a8-4a0d-b269-b8da6198a1f4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:42.853327 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d1360dfa-b2a8-4a0d-b269-b8da6198a1f4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:42.891224 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d1360dfa-b2a8-4a0d-b269-b8da6198a1f4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077296 Sep 01 14:04:42.892995 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 272/571] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:04:42 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:42.920099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5ec09d81-9f6a-46e4-bf01-208b454c7dc8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:42.931772 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5ec09d81-9f6a-46e4-bf01-208b454c7dc8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:42.933410 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5ec09d81-9f6a-46e4-bf01-208b454c7dc8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:42.940381 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-68f3296e-534d-411c-b5ad-1257ffd1c6d3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:42.940990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-68f3296e-534d-411c-b5ad-1257ffd1c6d3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:42.946954 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-5ec09d81-9f6a-46e4-bf01-208b454c7dc8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.179407 Sep 01 14:04:42.947620 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 300/572] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:42 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:42.949263 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-68f3296e-534d-411c-b5ad-1257ffd1c6d3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:42.949759 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-68f3296e-534d-411c-b5ad-1257ffd1c6d3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:42.950216 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-68f3296e-534d-411c-b5ad-1257ffd1c6d3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:42.950924 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-68f3296e-534d-411c-b5ad-1257ffd1c6d3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:42.951372 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-68f3296e-534d-411c-b5ad-1257ffd1c6d3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:42.951795 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-68f3296e-534d-411c-b5ad-1257ffd1c6d3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:43.111304 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-68f3296e-534d-411c-b5ad-1257ffd1c6d3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:43.121545 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-68f3296e-534d-411c-b5ad-1257ffd1c6d3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.185508 Sep 01 14:04:43.122794 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 273/573] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:42 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:43.365117 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a459e290-313f-4a27-ad94-0ff555ed63f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:43.365117 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a459e290-313f-4a27-ad94-0ff555ed63f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:43.377600 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a459e290-313f-4a27-ad94-0ff555ed63f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:43.378574 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a459e290-313f-4a27-ad94-0ff555ed63f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:43.379325 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a459e290-313f-4a27-ad94-0ff555ed63f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:43.384031 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a459e290-313f-4a27-ad94-0ff555ed63f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:43.384031 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a459e290-313f-4a27-ad94-0ff555ed63f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:43.384031 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a459e290-313f-4a27-ad94-0ff555ed63f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:43.565275 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a459e290-313f-4a27-ad94-0ff555ed63f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:43.577399 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a459e290-313f-4a27-ad94-0ff555ed63f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1663 microversion: 2.1 time: 0.218402 Sep 01 14:04:43.589802 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 301/574] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:43 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1663 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:43.908860 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7b8302fd-09d8-4915-b75d-dd3609eb3172 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:43.911819 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7b8302fd-09d8-4915-b75d-dd3609eb3172 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:43.920265 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7b8302fd-09d8-4915-b75d-dd3609eb3172 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:43.921139 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7b8302fd-09d8-4915-b75d-dd3609eb3172 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:43.921668 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7b8302fd-09d8-4915-b75d-dd3609eb3172 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:43.922622 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7b8302fd-09d8-4915-b75d-dd3609eb3172 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:43.923277 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7b8302fd-09d8-4915-b75d-dd3609eb3172 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:43.923906 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7b8302fd-09d8-4915-b75d-dd3609eb3172 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:43.972463 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9b166ec6-db69-40f4-a743-045b8f545a7c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:43.974408 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9b166ec6-db69-40f4-a743-045b8f545a7c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:43.981539 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7b8302fd-09d8-4915-b75d-dd3609eb3172 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076581 Sep 01 14:04:43.983454 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 274/575] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:04:43 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:43.985454 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b166ec6-db69-40f4-a743-045b8f545a7c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:43.986270 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b166ec6-db69-40f4-a743-045b8f545a7c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:43.986943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b166ec6-db69-40f4-a743-045b8f545a7c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:43.987987 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b166ec6-db69-40f4-a743-045b8f545a7c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:43.988734 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b166ec6-db69-40f4-a743-045b8f545a7c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:43.989459 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b166ec6-db69-40f4-a743-045b8f545a7c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:44.145698 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9b166ec6-db69-40f4-a743-045b8f545a7c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:44.148790 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0b3ca6f7-e00b-4d17-a2c7-527eeadfb083 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:44.149420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0b3ca6f7-e00b-4d17-a2c7-527eeadfb083 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:44.155288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9b166ec6-db69-40f4-a743-045b8f545a7c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:44.156730 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9b166ec6-db69-40f4-a743-045b8f545a7c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:44.156957 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0b3ca6f7-e00b-4d17-a2c7-527eeadfb083 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:44.157621 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0b3ca6f7-e00b-4d17-a2c7-527eeadfb083 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:44.157934 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9b166ec6-db69-40f4-a743-045b8f545a7c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.190132 Sep 01 14:04:44.158490 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 302/576] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:43 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:44.158625 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0b3ca6f7-e00b-4d17-a2c7-527eeadfb083 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:44.159676 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0b3ca6f7-e00b-4d17-a2c7-527eeadfb083 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:44.160311 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0b3ca6f7-e00b-4d17-a2c7-527eeadfb083 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:44.160993 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0b3ca6f7-e00b-4d17-a2c7-527eeadfb083 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:44.322438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0b3ca6f7-e00b-4d17-a2c7-527eeadfb083 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:44.333149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0b3ca6f7-e00b-4d17-a2c7-527eeadfb083 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.189320 Sep 01 14:04:44.345805 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 275/577] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:44 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:44.601366 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-13605081-04c4-432a-8574-f9cd25d9dbaf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:44.602618 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-13605081-04c4-432a-8574-f9cd25d9dbaf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:44.610756 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13605081-04c4-432a-8574-f9cd25d9dbaf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:44.611501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13605081-04c4-432a-8574-f9cd25d9dbaf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:44.612301 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13605081-04c4-432a-8574-f9cd25d9dbaf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:44.613101 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13605081-04c4-432a-8574-f9cd25d9dbaf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:44.613668 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13605081-04c4-432a-8574-f9cd25d9dbaf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:44.614204 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13605081-04c4-432a-8574-f9cd25d9dbaf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:44.779076 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-13605081-04c4-432a-8574-f9cd25d9dbaf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:44.787393 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-13605081-04c4-432a-8574-f9cd25d9dbaf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1663 microversion: 2.1 time: 0.191062 Sep 01 14:04:44.788571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 303/578] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:44 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1663 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:44.997161 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1e529ee1-93f5-4bf5-86fb-ba81b9dba7d2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:44.999660 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1e529ee1-93f5-4bf5-86fb-ba81b9dba7d2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:45.007148 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1e529ee1-93f5-4bf5-86fb-ba81b9dba7d2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:45.007659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1e529ee1-93f5-4bf5-86fb-ba81b9dba7d2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:45.008095 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1e529ee1-93f5-4bf5-86fb-ba81b9dba7d2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:45.008824 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1e529ee1-93f5-4bf5-86fb-ba81b9dba7d2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:45.009306 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1e529ee1-93f5-4bf5-86fb-ba81b9dba7d2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:45.009735 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1e529ee1-93f5-4bf5-86fb-ba81b9dba7d2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:45.014229 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:45.046005 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1e529ee1-93f5-4bf5-86fb-ba81b9dba7d2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052947 Sep 01 14:04:45.046701 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 276/579] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:04:44 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:45.180214 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-69a03574-f809-491d-be45-ee281162d57c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:45.180852 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-69a03574-f809-491d-be45-ee281162d57c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:45.198499 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-69a03574-f809-491d-be45-ee281162d57c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:45.199012 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-69a03574-f809-491d-be45-ee281162d57c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:45.199489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-69a03574-f809-491d-be45-ee281162d57c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:45.200575 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-69a03574-f809-491d-be45-ee281162d57c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:45.201054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-69a03574-f809-491d-be45-ee281162d57c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:45.201484 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-69a03574-f809-491d-be45-ee281162d57c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:45.205059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:45.350601 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-69a03574-f809-491d-be45-ee281162d57c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:45.355648 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3b7a7e6a-ad57-4f70-b74f-fb8bb315cd4b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:45.356254 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3b7a7e6a-ad57-4f70-b74f-fb8bb315cd4b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:45.359698 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-69a03574-f809-491d-be45-ee281162d57c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:45.361156 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-69a03574-f809-491d-be45-ee281162d57c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:45.362357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-69a03574-f809-491d-be45-ee281162d57c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.186528 Sep 01 14:04:45.362913 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 304/580] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:45 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:45.363478 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b7a7e6a-ad57-4f70-b74f-fb8bb315cd4b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:45.363968 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b7a7e6a-ad57-4f70-b74f-fb8bb315cd4b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:45.364432 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b7a7e6a-ad57-4f70-b74f-fb8bb315cd4b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:45.366701 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b7a7e6a-ad57-4f70-b74f-fb8bb315cd4b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:45.367283 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b7a7e6a-ad57-4f70-b74f-fb8bb315cd4b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:45.367895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b7a7e6a-ad57-4f70-b74f-fb8bb315cd4b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:45.546758 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3b7a7e6a-ad57-4f70-b74f-fb8bb315cd4b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:45.558318 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3b7a7e6a-ad57-4f70-b74f-fb8bb315cd4b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.206714 Sep 01 14:04:45.559104 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 277/581] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:45 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:45.813636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-67d43f09-0a21-4e4c-aa57-02284f99b5e2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:45.814179 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-67d43f09-0a21-4e4c-aa57-02284f99b5e2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:45.824481 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67d43f09-0a21-4e4c-aa57-02284f99b5e2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:45.824972 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67d43f09-0a21-4e4c-aa57-02284f99b5e2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:45.825409 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67d43f09-0a21-4e4c-aa57-02284f99b5e2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:45.826148 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67d43f09-0a21-4e4c-aa57-02284f99b5e2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:45.826605 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67d43f09-0a21-4e4c-aa57-02284f99b5e2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:45.827033 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67d43f09-0a21-4e4c-aa57-02284f99b5e2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:46.002901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-67d43f09-0a21-4e4c-aa57-02284f99b5e2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:46.011671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-67d43f09-0a21-4e4c-aa57-02284f99b5e2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1663 microversion: 2.1 time: 0.202003 Sep 01 14:04:46.012527 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 305/582] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:45 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1663 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:46.058413 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0b6ad824-450c-4407-bc2c-d4ae4aa711a5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:46.061164 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0b6ad824-450c-4407-bc2c-d4ae4aa711a5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:46.068113 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0b6ad824-450c-4407-bc2c-d4ae4aa711a5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:46.068934 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0b6ad824-450c-4407-bc2c-d4ae4aa711a5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:46.069589 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0b6ad824-450c-4407-bc2c-d4ae4aa711a5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:46.070568 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0b6ad824-450c-4407-bc2c-d4ae4aa711a5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:46.071728 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0b6ad824-450c-4407-bc2c-d4ae4aa711a5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:46.072346 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0b6ad824-450c-4407-bc2c-d4ae4aa711a5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:46.105088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0b6ad824-450c-4407-bc2c-d4ae4aa711a5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051122 Sep 01 14:04:46.105748 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 278/583] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:04:46 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:46.385938 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-608fc2d5-5a9f-4e29-8f82-398071c0e201 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:46.386570 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-608fc2d5-5a9f-4e29-8f82-398071c0e201 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:46.393882 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-608fc2d5-5a9f-4e29-8f82-398071c0e201 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:46.394312 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-608fc2d5-5a9f-4e29-8f82-398071c0e201 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:46.394780 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-608fc2d5-5a9f-4e29-8f82-398071c0e201 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:46.395484 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-608fc2d5-5a9f-4e29-8f82-398071c0e201 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:46.396080 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-608fc2d5-5a9f-4e29-8f82-398071c0e201 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:46.396504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-608fc2d5-5a9f-4e29-8f82-398071c0e201 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:46.579865 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-608fc2d5-5a9f-4e29-8f82-398071c0e201 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:46.591832 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-608fc2d5-5a9f-4e29-8f82-398071c0e201 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:46.593539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-608fc2d5-5a9f-4e29-8f82-398071c0e201 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:46.594742 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-608fc2d5-5a9f-4e29-8f82-398071c0e201 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1806 microversion: 2.20 time: 0.212734 Sep 01 14:04:46.599643 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 306/584] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:46 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1806 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:46.615998 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c327c846-98c2-429d-874b-5e5febc58904 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:46.618696 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c327c846-98c2-429d-874b-5e5febc58904 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:46.636213 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c327c846-98c2-429d-874b-5e5febc58904 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:46.636921 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c327c846-98c2-429d-874b-5e5febc58904 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:46.638093 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c327c846-98c2-429d-874b-5e5febc58904 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:46.639410 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c327c846-98c2-429d-874b-5e5febc58904 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:46.640348 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c327c846-98c2-429d-874b-5e5febc58904 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:46.641367 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c327c846-98c2-429d-874b-5e5febc58904 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:46.843993 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c327c846-98c2-429d-874b-5e5febc58904 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:46.853144 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c327c846-98c2-429d-874b-5e5febc58904 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.271510 Sep 01 14:04:46.854409 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 279/585] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:46 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:47.037185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ab506d47-20e2-40ba-8e75-009b2dd04094 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:47.038373 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ab506d47-20e2-40ba-8e75-009b2dd04094 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:47.045036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab506d47-20e2-40ba-8e75-009b2dd04094 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:47.045980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab506d47-20e2-40ba-8e75-009b2dd04094 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:47.046655 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab506d47-20e2-40ba-8e75-009b2dd04094 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:47.047613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab506d47-20e2-40ba-8e75-009b2dd04094 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:47.048359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab506d47-20e2-40ba-8e75-009b2dd04094 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:47.048877 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab506d47-20e2-40ba-8e75-009b2dd04094 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:47.117432 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4f94cc66-0bf5-4eb9-a542-ca9077033419 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:47.120408 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4f94cc66-0bf5-4eb9-a542-ca9077033419 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:47.133659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f94cc66-0bf5-4eb9-a542-ca9077033419 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:47.136877 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f94cc66-0bf5-4eb9-a542-ca9077033419 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:47.137622 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f94cc66-0bf5-4eb9-a542-ca9077033419 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:47.138462 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f94cc66-0bf5-4eb9-a542-ca9077033419 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:47.138946 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f94cc66-0bf5-4eb9-a542-ca9077033419 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:47.139399 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f94cc66-0bf5-4eb9-a542-ca9077033419 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:47.215316 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4f94cc66-0bf5-4eb9-a542-ca9077033419 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102030 Sep 01 14:04:47.216314 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 280/586] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:04:47 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:04:47.411208 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ab506d47-20e2-40ba-8e75-009b2dd04094 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:47.427953 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ab506d47-20e2-40ba-8e75-009b2dd04094 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1663 microversion: 2.1 time: 0.393249 Sep 01 14:04:47.467205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 307/587] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:47 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1663 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:47.644483 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-de28e784-21f8-4d86-9030-0ca3d6df6d81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:47.649348 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-de28e784-21f8-4d86-9030-0ca3d6df6d81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:47.664349 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-de28e784-21f8-4d86-9030-0ca3d6df6d81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:47.665411 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-de28e784-21f8-4d86-9030-0ca3d6df6d81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:47.666555 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-de28e784-21f8-4d86-9030-0ca3d6df6d81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:47.667828 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-de28e784-21f8-4d86-9030-0ca3d6df6d81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:47.668670 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-de28e784-21f8-4d86-9030-0ca3d6df6d81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:47.669396 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-de28e784-21f8-4d86-9030-0ca3d6df6d81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:47.878441 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9825cd77-8591-4739-b1b6-391496a73fa8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:47.880204 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9825cd77-8591-4739-b1b6-391496a73fa8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:47.888678 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9825cd77-8591-4739-b1b6-391496a73fa8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:47.889924 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9825cd77-8591-4739-b1b6-391496a73fa8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:47.890732 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9825cd77-8591-4739-b1b6-391496a73fa8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:47.891826 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9825cd77-8591-4739-b1b6-391496a73fa8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:47.892447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9825cd77-8591-4739-b1b6-391496a73fa8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:47.893170 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9825cd77-8591-4739-b1b6-391496a73fa8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:48.137680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-de28e784-21f8-4d86-9030-0ca3d6df6d81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:48.165264 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-de28e784-21f8-4d86-9030-0ca3d6df6d81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:48.172529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-de28e784-21f8-4d86-9030-0ca3d6df6d81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:48.177567 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-de28e784-21f8-4d86-9030-0ca3d6df6d81 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1793 microversion: 2.20 time: 0.540885 Sep 01 14:04:48.180665 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 281/588] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:04:47 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1793 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:04:48.258221 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e5797210-ceb6-4b7a-b971-1c5acef25586 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:48.266816 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e5797210-ceb6-4b7a-b971-1c5acef25586 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:48.283933 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5797210-ceb6-4b7a-b971-1c5acef25586 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:48.284427 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5797210-ceb6-4b7a-b971-1c5acef25586 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:48.284869 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5797210-ceb6-4b7a-b971-1c5acef25586 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:48.290215 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5797210-ceb6-4b7a-b971-1c5acef25586 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:48.291147 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5797210-ceb6-4b7a-b971-1c5acef25586 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:48.292201 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5797210-ceb6-4b7a-b971-1c5acef25586 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:48.354016 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e5797210-ceb6-4b7a-b971-1c5acef25586 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126319 Sep 01 14:04:48.355502 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 282/589] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:04:48 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:04:48.409856 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9825cd77-8591-4739-b1b6-391496a73fa8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:48.422650 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9825cd77-8591-4739-b1b6-391496a73fa8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.550703 Sep 01 14:04:48.423758 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 308/590] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:47 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:48.453281 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-bb792fb6-0313-41af-9727-e2c308f36dc7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:48.453967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-bb792fb6-0313-41af-9727-e2c308f36dc7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:48.460668 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bb792fb6-0313-41af-9727-e2c308f36dc7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:48.461611 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bb792fb6-0313-41af-9727-e2c308f36dc7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:48.461731 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bb792fb6-0313-41af-9727-e2c308f36dc7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:48.462421 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bb792fb6-0313-41af-9727-e2c308f36dc7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:48.462884 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bb792fb6-0313-41af-9727-e2c308f36dc7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:48.463318 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bb792fb6-0313-41af-9727-e2c308f36dc7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:48.881088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-bb792fb6-0313-41af-9727-e2c308f36dc7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:48.892888 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-bb792fb6-0313-41af-9727-e2c308f36dc7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1663 microversion: 2.1 time: 0.444024 Sep 01 14:04:48.905838 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 283/591] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:48 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1663 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:48.991153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-521d6687-0463-45d5-9fad-48c85e7dfafa req-1332057b-d1db-4e07-a99c-53f4d90e23bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901d0282-c949-4f4d-9f04-7141c3b42480", "tag": "79b8068f-760a-42ca-86d8-b6f065560433"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:49.011823 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-521d6687-0463-45d5-9fad-48c85e7dfafa req-1332057b-d1db-4e07-a99c-53f4d90e23bf service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:49.013027 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-521d6687-0463-45d5-9fad-48c85e7dfafa req-1332057b-d1db-4e07-a99c-53f4d90e23bf service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:49.013900 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-521d6687-0463-45d5-9fad-48c85e7dfafa req-1332057b-d1db-4e07-a99c-53f4d90e23bf service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:49.039458 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-521d6687-0463-45d5-9fad-48c85e7dfafa req-1332057b-d1db-4e07-a99c-53f4d90e23bf service nova] Creating event network-changed:79b8068f-760a-42ca-86d8-b6f065560433 for instance 901d0282-c949-4f4d-9f04-7141c3b42480 on hv-cinder-85221 Sep 01 14:04:49.053120 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-521d6687-0463-45d5-9fad-48c85e7dfafa req-1332057b-d1db-4e07-a99c-53f4d90e23bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069538 Sep 01 14:04:49.054786 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 309/592] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:49.375708 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-10d5ebae-1b69-4cbf-856b-5760884a3a08 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:49.385891 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-10d5ebae-1b69-4cbf-856b-5760884a3a08 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:49.408505 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10d5ebae-1b69-4cbf-856b-5760884a3a08 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:49.409873 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10d5ebae-1b69-4cbf-856b-5760884a3a08 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:49.411808 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10d5ebae-1b69-4cbf-856b-5760884a3a08 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:49.413549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10d5ebae-1b69-4cbf-856b-5760884a3a08 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:49.414690 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10d5ebae-1b69-4cbf-856b-5760884a3a08 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:49.415477 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10d5ebae-1b69-4cbf-856b-5760884a3a08 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:49.447519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d6028107-8237-401d-90a0-339b42f76415 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:49.449007 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d6028107-8237-401d-90a0-339b42f76415 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:49.461186 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d6028107-8237-401d-90a0-339b42f76415 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:49.462481 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d6028107-8237-401d-90a0-339b42f76415 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:49.464151 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d6028107-8237-401d-90a0-339b42f76415 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:49.465625 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d6028107-8237-401d-90a0-339b42f76415 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:49.466890 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d6028107-8237-401d-90a0-339b42f76415 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:49.468412 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d6028107-8237-401d-90a0-339b42f76415 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:49.485860 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-10d5ebae-1b69-4cbf-856b-5760884a3a08 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.117525 Sep 01 14:04:49.487311 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 284/593] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:04:49 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa/os-volume_attachments => generated 25 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:04:49.595254 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2c1f9a2a-03f1-4a24-a90f-c1e8ddbd423d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:49.595749 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2c1f9a2a-03f1-4a24-a90f-c1e8ddbd423d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:49.602867 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2c1f9a2a-03f1-4a24-a90f-c1e8ddbd423d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:49.603367 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2c1f9a2a-03f1-4a24-a90f-c1e8ddbd423d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:49.603809 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2c1f9a2a-03f1-4a24-a90f-c1e8ddbd423d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:49.604582 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2c1f9a2a-03f1-4a24-a90f-c1e8ddbd423d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:49.605039 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2c1f9a2a-03f1-4a24-a90f-c1e8ddbd423d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:49.605691 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2c1f9a2a-03f1-4a24-a90f-c1e8ddbd423d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:49.642355 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2c1f9a2a-03f1-4a24-a90f-c1e8ddbd423d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Going to try to terminate instance {{(pid=127812) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:04:49.803025 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d6028107-8237-401d-90a0-339b42f76415 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:49.812464 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d6028107-8237-401d-90a0-339b42f76415 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.370660 Sep 01 14:04:49.813651 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 310/594] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:49 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:49.918445 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-775123e3-4c3a-4329-8bd2-2873cf30e9ee tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:49.919363 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-775123e3-4c3a-4329-8bd2-2873cf30e9ee tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:49.933808 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-775123e3-4c3a-4329-8bd2-2873cf30e9ee tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:49.943728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-775123e3-4c3a-4329-8bd2-2873cf30e9ee tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:49.944623 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-775123e3-4c3a-4329-8bd2-2873cf30e9ee tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:49.946934 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-775123e3-4c3a-4329-8bd2-2873cf30e9ee tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:49.947599 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-775123e3-4c3a-4329-8bd2-2873cf30e9ee tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:49.948105 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-775123e3-4c3a-4329-8bd2-2873cf30e9ee tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:50.022808 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2c1f9a2a-03f1-4a24-a90f-c1e8ddbd423d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 204 len: 0 microversion: 2.1 time: 0.428714 Sep 01 14:04:50.025323 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 285/595] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:04:49 2022] DELETE /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:04:50.038857 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-eee8491f-caa1-42e6-a1f4-3a0d44ed9d27 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:50.040373 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-eee8491f-caa1-42e6-a1f4-3a0d44ed9d27 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:50.055408 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eee8491f-caa1-42e6-a1f4-3a0d44ed9d27 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:50.056693 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eee8491f-caa1-42e6-a1f4-3a0d44ed9d27 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:50.060623 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eee8491f-caa1-42e6-a1f4-3a0d44ed9d27 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:50.060623 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eee8491f-caa1-42e6-a1f4-3a0d44ed9d27 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:50.060623 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eee8491f-caa1-42e6-a1f4-3a0d44ed9d27 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:50.061742 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eee8491f-caa1-42e6-a1f4-3a0d44ed9d27 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:50.183415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-775123e3-4c3a-4329-8bd2-2873cf30e9ee tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:50.196374 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-775123e3-4c3a-4329-8bd2-2873cf30e9ee tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1663 microversion: 2.1 time: 0.284173 Sep 01 14:04:50.217137 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 311/596] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:49 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1663 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:50.251720 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-eee8491f-caa1-42e6-a1f4-3a0d44ed9d27 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:50.263927 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-eee8491f-caa1-42e6-a1f4-3a0d44ed9d27 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1684 microversion: 2.1 time: 0.232965 Sep 01 14:04:50.265488 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 286/597] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:50 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1684 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:50.833798 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-57430cf2-5633-4be4-b7fc-bdb939be078d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:50.834680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-57430cf2-5633-4be4-b7fc-bdb939be078d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:50.842131 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-57430cf2-5633-4be4-b7fc-bdb939be078d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:50.843040 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-57430cf2-5633-4be4-b7fc-bdb939be078d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:50.843759 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-57430cf2-5633-4be4-b7fc-bdb939be078d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:50.844763 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-57430cf2-5633-4be4-b7fc-bdb939be078d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:50.845360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-57430cf2-5633-4be4-b7fc-bdb939be078d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:50.846087 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-57430cf2-5633-4be4-b7fc-bdb939be078d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:50.994626 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-57430cf2-5633-4be4-b7fc-bdb939be078d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:51.004009 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-57430cf2-5633-4be4-b7fc-bdb939be078d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.173993 Sep 01 14:04:51.004538 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 312/598] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:50 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:51.227983 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1c742eb5-3a2a-4caa-a628-d8ff58fafae3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:51.228653 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1c742eb5-3a2a-4caa-a628-d8ff58fafae3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:51.235863 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c742eb5-3a2a-4caa-a628-d8ff58fafae3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:51.236690 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c742eb5-3a2a-4caa-a628-d8ff58fafae3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:51.237328 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c742eb5-3a2a-4caa-a628-d8ff58fafae3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:51.238259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c742eb5-3a2a-4caa-a628-d8ff58fafae3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:51.239605 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c742eb5-3a2a-4caa-a628-d8ff58fafae3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:51.240498 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c742eb5-3a2a-4caa-a628-d8ff58fafae3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:51.300220 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8e4188d8-3373-4912-8156-847017a498e4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:51.301862 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8e4188d8-3373-4912-8156-847017a498e4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:51.310280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8e4188d8-3373-4912-8156-847017a498e4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:51.316012 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8e4188d8-3373-4912-8156-847017a498e4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:51.319061 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8e4188d8-3373-4912-8156-847017a498e4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:51.319688 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8e4188d8-3373-4912-8156-847017a498e4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:51.320324 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8e4188d8-3373-4912-8156-847017a498e4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:51.320917 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8e4188d8-3373-4912-8156-847017a498e4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:51.504819 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1c742eb5-3a2a-4caa-a628-d8ff58fafae3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:51.517520 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1c742eb5-3a2a-4caa-a628-d8ff58fafae3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1667 microversion: 2.1 time: 0.289824 Sep 01 14:04:51.517520 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 287/599] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:51 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1667 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:51.591734 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-8e4188d8-3373-4912-8156-847017a498e4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:51.601617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8e4188d8-3373-4912-8156-847017a498e4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1684 microversion: 2.1 time: 0.308950 Sep 01 14:04:51.602343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 313/600] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:51 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1684 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:52.026384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3087a07b-74e3-40f3-b172-066d73c955e0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:52.026985 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3087a07b-74e3-40f3-b172-066d73c955e0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:52.032916 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3087a07b-74e3-40f3-b172-066d73c955e0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:52.033400 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3087a07b-74e3-40f3-b172-066d73c955e0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:52.033861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3087a07b-74e3-40f3-b172-066d73c955e0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:52.034567 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3087a07b-74e3-40f3-b172-066d73c955e0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:52.035021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3087a07b-74e3-40f3-b172-066d73c955e0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:52.036090 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3087a07b-74e3-40f3-b172-066d73c955e0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:52.192971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3087a07b-74e3-40f3-b172-066d73c955e0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:52.201976 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3087a07b-74e3-40f3-b172-066d73c955e0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.179315 Sep 01 14:04:52.203026 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 288/601] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:52 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:52.627624 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0f328cb4-5e44-44fe-833b-668d07c458d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:52.628799 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0f328cb4-5e44-44fe-833b-668d07c458d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:52.640121 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0f328cb4-5e44-44fe-833b-668d07c458d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:52.641094 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0f328cb4-5e44-44fe-833b-668d07c458d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:52.642032 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0f328cb4-5e44-44fe-833b-668d07c458d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:52.643352 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0f328cb4-5e44-44fe-833b-668d07c458d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:52.644195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0f328cb4-5e44-44fe-833b-668d07c458d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:52.645493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0f328cb4-5e44-44fe-833b-668d07c458d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:53.224148 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-75bc5f1f-406c-48aa-a5f6-81d3e6e78f84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:53.224575 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-75bc5f1f-406c-48aa-a5f6-81d3e6e78f84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:53.230958 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-75bc5f1f-406c-48aa-a5f6-81d3e6e78f84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:53.231152 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0f328cb4-5e44-44fe-833b-668d07c458d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:53.231570 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-75bc5f1f-406c-48aa-a5f6-81d3e6e78f84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:53.232077 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-75bc5f1f-406c-48aa-a5f6-81d3e6e78f84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:53.233017 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-75bc5f1f-406c-48aa-a5f6-81d3e6e78f84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:53.233472 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-75bc5f1f-406c-48aa-a5f6-81d3e6e78f84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:53.234087 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-75bc5f1f-406c-48aa-a5f6-81d3e6e78f84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:53.241908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0f328cb4-5e44-44fe-833b-668d07c458d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1684 microversion: 2.1 time: 0.621407 Sep 01 14:04:53.242747 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 314/602] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:52 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1684 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:53.563618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-75bc5f1f-406c-48aa-a5f6-81d3e6e78f84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:53.572613 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-75bc5f1f-406c-48aa-a5f6-81d3e6e78f84 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.352836 Sep 01 14:04:53.573713 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 289/603] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:53 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:04:54.267131 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8578f972-2623-4cc8-ab96-17d824d71974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:54.267749 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8578f972-2623-4cc8-ab96-17d824d71974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:54.276013 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8578f972-2623-4cc8-ab96-17d824d71974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:54.276531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8578f972-2623-4cc8-ab96-17d824d71974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:54.283895 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8578f972-2623-4cc8-ab96-17d824d71974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:54.283895 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8578f972-2623-4cc8-ab96-17d824d71974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:54.283895 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8578f972-2623-4cc8-ab96-17d824d71974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:54.283895 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8578f972-2623-4cc8-ab96-17d824d71974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:54.320257 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-ea7df444-03c8-4ed8-bd8a-e53687ff27f2 req-c462b822-e61f-4183-997d-afa99bfccf9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa", "name": "network-vif-deleted", "tag": "7a4ac6bc-64b7-41cb-85da-676a789e1725"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:54.338434 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ea7df444-03c8-4ed8-bd8a-e53687ff27f2 req-c462b822-e61f-4183-997d-afa99bfccf9d service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:54.341593 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ea7df444-03c8-4ed8-bd8a-e53687ff27f2 req-c462b822-e61f-4183-997d-afa99bfccf9d service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:54.341593 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ea7df444-03c8-4ed8-bd8a-e53687ff27f2 req-c462b822-e61f-4183-997d-afa99bfccf9d service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:54.361893 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-8578f972-2623-4cc8-ab96-17d824d71974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:54.363927 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-ea7df444-03c8-4ed8-bd8a-e53687ff27f2 req-c462b822-e61f-4183-997d-afa99bfccf9d service nova] Creating event network-vif-deleted:7a4ac6bc-64b7-41cb-85da-676a789e1725 for instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa on hv-cinder-85221 Sep 01 14:04:54.369125 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-ea7df444-03c8-4ed8-bd8a-e53687ff27f2 req-c462b822-e61f-4183-997d-afa99bfccf9d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054542 Sep 01 14:04:54.369844 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 290/604] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:04:54.380281 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8578f972-2623-4cc8-ab96-17d824d71974 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1616 microversion: 2.1 time: 0.120096 Sep 01 14:04:54.382698 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 315/605] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:54 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1616 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:54.593041 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3836c50d-83fa-4af7-957f-af8664fef845 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:54.594029 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3836c50d-83fa-4af7-957f-af8664fef845 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:54.600534 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3836c50d-83fa-4af7-957f-af8664fef845 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:54.601024 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3836c50d-83fa-4af7-957f-af8664fef845 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:54.601456 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3836c50d-83fa-4af7-957f-af8664fef845 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:54.602376 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3836c50d-83fa-4af7-957f-af8664fef845 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:54.602833 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3836c50d-83fa-4af7-957f-af8664fef845 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:54.603262 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3836c50d-83fa-4af7-957f-af8664fef845 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:54.759759 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3836c50d-83fa-4af7-957f-af8664fef845 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:54.764555 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:54.771247 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3836c50d-83fa-4af7-957f-af8664fef845 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.182265 Sep 01 14:04:54.782720 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 291/606] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:54 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:55.403778 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:55.404353 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:55.411885 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:55.412643 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:55.413158 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:55.413935 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:55.414389 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:55.414983 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:55.449542 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:55.452479 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:55.452996 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:55.453379 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lazy-loading 'fault' on Instance uuid 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:55.519197 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:55.522966 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-bcad0fbb-f634-45fd-bf37-f9a945df29aa tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1332 microversion: 2.1 time: 0.123754 Sep 01 14:04:55.529499 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 316/607] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:55 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1332 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:55.792740 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-fb5d62e6-71ed-4b36-9d50-dd6983583d9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:55.793497 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fb5d62e6-71ed-4b36-9d50-dd6983583d9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:55.800912 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb5d62e6-71ed-4b36-9d50-dd6983583d9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:55.801427 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb5d62e6-71ed-4b36-9d50-dd6983583d9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:55.801910 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb5d62e6-71ed-4b36-9d50-dd6983583d9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:55.802617 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb5d62e6-71ed-4b36-9d50-dd6983583d9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:55.803111 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb5d62e6-71ed-4b36-9d50-dd6983583d9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:55.810784 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fb5d62e6-71ed-4b36-9d50-dd6983583d9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:55.944591 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fb5d62e6-71ed-4b36-9d50-dd6983583d9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:55.952673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-fb5d62e6-71ed-4b36-9d50-dd6983583d9b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.163758 Sep 01 14:04:55.953935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 292/608] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:55 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:56.545725 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:56.546269 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:56.549846 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:04:56.553986 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:56.554486 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:56.560140 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:56.560140 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:56.560140 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:56.560140 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:56.589819 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:56.590306 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:56.590745 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:56.591197 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lazy-loading 'fault' on Instance uuid 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:04:56.632608 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:56.639801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-aa42ab26-d10b-4689-afd7-b45aefd74cc2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 200 len: 1332 microversion: 2.1 time: 0.098010 Sep 01 14:04:56.640377 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 317/609] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:56 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:56.975251 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-91b4572d-f752-4099-a3ed-9d402468e02c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:56.976010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-91b4572d-f752-4099-a3ed-9d402468e02c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:56.982495 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91b4572d-f752-4099-a3ed-9d402468e02c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:56.982981 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91b4572d-f752-4099-a3ed-9d402468e02c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:56.983419 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91b4572d-f752-4099-a3ed-9d402468e02c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:56.984119 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91b4572d-f752-4099-a3ed-9d402468e02c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:56.984575 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91b4572d-f752-4099-a3ed-9d402468e02c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:56.985004 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91b4572d-f752-4099-a3ed-9d402468e02c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:57.116191 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-91b4572d-f752-4099-a3ed-9d402468e02c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:57.123906 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-91b4572d-f752-4099-a3ed-9d402468e02c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.153474 Sep 01 14:04:57.124737 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 293/610] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:56 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:57.660353 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b1d57174-956e-4571-ba6a-2875b26c27be tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:57.660956 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b1d57174-956e-4571-ba6a-2875b26c27be tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:57.667312 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b1d57174-956e-4571-ba6a-2875b26c27be tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:57.667797 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b1d57174-956e-4571-ba6a-2875b26c27be tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:57.668226 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b1d57174-956e-4571-ba6a-2875b26c27be tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:57.668911 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b1d57174-956e-4571-ba6a-2875b26c27be tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:57.669357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b1d57174-956e-4571-ba6a-2875b26c27be tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:57.669793 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b1d57174-956e-4571-ba6a-2875b26c27be tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:57.682913 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-b1d57174-956e-4571-ba6a-2875b26c27be tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b1d57174-956e-4571-ba6a-2875b26c27be tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa HTTP/1.1 Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:04:57.684519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:04:57.688036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:04:57.688036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:04:57.688036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:04:57.688036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:04:57.688036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:04:57.688036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:04:57.688036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:04:57.688036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:04:57.688036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:04:57.688036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:04:57.688036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:04:57.688036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa'} Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:04:57.688980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:04:57.692072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:04:57.693351 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b1d57174-956e-4571-ba6a-2875b26c27be tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 404 to user: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:04:57.693351 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b1d57174-956e-4571-ba6a-2875b26c27be tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 404 len: 111 microversion: 2.1 time: 0.029492 Sep 01 14:04:57.693351 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 318/611] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:57 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:04:57.695395 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-cc8cb5d1-c86c-4d11-99af-21d1b8272cd4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '.version_select at 0x7f1afd217f70>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:57.797113 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-cc8cb5d1-c86c-4d11-99af-21d1b8272cd4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843613736" status: 202 len: 0 microversion: 2.1 time: 0.105990 Sep 01 14:04:57.797637 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 294/612] 10.222.0.61 () {58 vars in 1221 bytes} [Thu Sep 1 14:04:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843613736 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:04:58.150621 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5ff6e454-ea88-4784-9b93-094b997ae2d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:58.151242 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-5ff6e454-ea88-4784-9b93-094b997ae2d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:58.158527 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ff6e454-ea88-4784-9b93-094b997ae2d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:58.159022 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ff6e454-ea88-4784-9b93-094b997ae2d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:58.159575 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ff6e454-ea88-4784-9b93-094b997ae2d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:58.160357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ff6e454-ea88-4784-9b93-094b997ae2d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:58.160995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ff6e454-ea88-4784-9b93-094b997ae2d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:58.161440 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ff6e454-ea88-4784-9b93-094b997ae2d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:58.358653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5ff6e454-ea88-4784-9b93-094b997ae2d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:58.367575 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-5ff6e454-ea88-4784-9b93-094b997ae2d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.221650 Sep 01 14:04:58.368323 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 319/613] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:58 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:58.666699 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-13112ee8-cc8d-4b72-9a7f-784d8108e6ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Action: 'create', calling method: .version_select at 0x7f1afd215430>, body: {"keypair": {"name": "tempest-keypair-1943551087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAGtL/yvI+475KcNoktSblx4AfBo6QzVI+WKgBkwJe6crqdoUgMCWma1sk6rQS73r8ljD1OGocYIf24kAyZNV+x8kiUx0rXwr9b89/V+lac7UZ6/sEUlLpsYubYUnv7lg=="}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:04:58.684019 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-13112ee8-cc8d-4b72-9a7f-784d8108e6ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for project c19855b809cc43b2925dc3001284baaa. Resources: {'key_pairs'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:04:58.688151 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-13112ee8-cc8d-4b72-9a7f-784d8108e6ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for user c0afa15991f14e0ca0d3701d06a89049 and project c19855b809cc43b2925dc3001284baaa. Resources: {'key_pairs'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:04:58.811078 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-13112ee8-cc8d-4b72-9a7f-784d8108e6ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.148745 Sep 01 14:04:58.811925 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 295/614] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 1 14:04:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:04:59.389529 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-54b1a044-d127-43d0-8da5-fc29b7c2c570 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:04:59.390193 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-54b1a044-d127-43d0-8da5-fc29b7c2c570 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:04:59.396734 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-54b1a044-d127-43d0-8da5-fc29b7c2c570 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:59.397228 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-54b1a044-d127-43d0-8da5-fc29b7c2c570 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:59.397662 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-54b1a044-d127-43d0-8da5-fc29b7c2c570 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:59.398452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-54b1a044-d127-43d0-8da5-fc29b7c2c570 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:04:59.398945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-54b1a044-d127-43d0-8da5-fc29b7c2c570 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:04:59.399369 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-54b1a044-d127-43d0-8da5-fc29b7c2c570 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:04:59.563661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-54b1a044-d127-43d0-8da5-fc29b7c2c570 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:04:59.572314 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-54b1a044-d127-43d0-8da5-fc29b7c2c570 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.186622 Sep 01 14:04:59.573058 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 320/615] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:04:59 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:04:59.990267 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-ec89751f-6549-45e9-b7ca-dedec47d71a7 req-4ba5235b-d34f-4ea3-ab1a-28036abca3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901d0282-c949-4f4d-9f04-7141c3b42480", "name": "network-vif-plugged", "status": "completed", "tag": "79b8068f-760a-42ca-86d8-b6f065560433"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:00.000833 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:00.010620 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ec89751f-6549-45e9-b7ca-dedec47d71a7 req-4ba5235b-d34f-4ea3-ab1a-28036abca3cd service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:00.011477 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ec89751f-6549-45e9-b7ca-dedec47d71a7 req-4ba5235b-d34f-4ea3-ab1a-28036abca3cd service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:00.012855 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ec89751f-6549-45e9-b7ca-dedec47d71a7 req-4ba5235b-d34f-4ea3-ab1a-28036abca3cd service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:00.028078 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-ec89751f-6549-45e9-b7ca-dedec47d71a7 req-4ba5235b-d34f-4ea3-ab1a-28036abca3cd service nova] Creating event network-vif-plugged:79b8068f-760a-42ca-86d8-b6f065560433 for instance 901d0282-c949-4f4d-9f04-7141c3b42480 on hv-cinder-85221 Sep 01 14:05:00.033912 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-ec89751f-6549-45e9-b7ca-dedec47d71a7 req-4ba5235b-d34f-4ea3-ab1a-28036abca3cd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051310 Sep 01 14:05:00.034686 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 296/616] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:00.593628 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-6c8b13a3-4148-403c-b046-1b10f79595d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:00.594713 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-6c8b13a3-4148-403c-b046-1b10f79595d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:00.604349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6c8b13a3-4148-403c-b046-1b10f79595d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:00.605179 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6c8b13a3-4148-403c-b046-1b10f79595d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:00.606547 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6c8b13a3-4148-403c-b046-1b10f79595d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:00.607812 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6c8b13a3-4148-403c-b046-1b10f79595d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:00.608504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6c8b13a3-4148-403c-b046-1b10f79595d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:00.609723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6c8b13a3-4148-403c-b046-1b10f79595d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:00.630280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:00.832989 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-6c8b13a3-4148-403c-b046-1b10f79595d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:00.841710 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-6c8b13a3-4148-403c-b046-1b10f79595d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.252926 Sep 01 14:05:00.842324 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 321/617] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:00 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:01.465545 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1114101038", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ad8c667-b460-46c7-93b9-306c7a679d39"}], "security_groups": [{"name": "tempest-securitygroup--1872095695"}], "key_name": "tempest-keypair-1943551087", "user_data": "}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:01.572681 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.network.neutron [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] validate_networks() for [('9ad8c667-b460-46c7-93b9-306c7a679d39', None, None, None, None, None)] {{(pid=127812) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:05:01.863112 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-bac7fe5f-f242-4c8a-9e9e-68acae317363 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:01.863729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-bac7fe5f-f242-4c8a-9e9e-68acae317363 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:01.870431 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bac7fe5f-f242-4c8a-9e9e-68acae317363 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:01.870913 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bac7fe5f-f242-4c8a-9e9e-68acae317363 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:01.871346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bac7fe5f-f242-4c8a-9e9e-68acae317363 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:01.872039 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bac7fe5f-f242-4c8a-9e9e-68acae317363 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:01.872489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bac7fe5f-f242-4c8a-9e9e-68acae317363 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:01.872911 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bac7fe5f-f242-4c8a-9e9e-68acae317363 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:02.012949 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Flavor limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:05:02.013365 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Image limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:05:02.013885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Flavor pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:05:02.014298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Image pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:05:02.014853 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:05:02.024173 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:02.024691 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:02.025127 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:02.025893 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:02.026341 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:02.026780 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:02.046773 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for project c19855b809cc43b2925dc3001284baaa. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:05:02.048161 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-bac7fe5f-f242-4c8a-9e9e-68acae317363 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:02.048739 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for user c0afa15991f14e0ca0d3701d06a89049 and project c19855b809cc43b2925dc3001284baaa. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:05:02.061134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Going to run 1 instances... {{(pid=127812) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:05:02.061837 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-bac7fe5f-f242-4c8a-9e9e-68acae317363 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1369 microversion: 2.1 time: 0.202578 Sep 01 14:05:02.062411 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 322/618] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:01 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1369 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:02.073933 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:05:02.197479 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-fbbd8257-1cfb-4f34-aa6b-9746f53b3dc9 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.736483 Sep 01 14:05:02.203540 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 297/619] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:05:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:05:02.209783 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f9f97d71-ae20-4443-bcf7-1761e65bc923 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:02.210538 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f9f97d71-ae20-4443-bcf7-1761e65bc923 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:02.265110 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f9f97d71-ae20-4443-bcf7-1761e65bc923 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:02.273257 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f9f97d71-ae20-4443-bcf7-1761e65bc923 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1242 microversion: 2.1 time: 0.067845 Sep 01 14:05:02.280853 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 323/620] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:02 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:03.083351 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-32c17865-e163-413c-93d5-fd783f3bbcd7 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:03.083962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-32c17865-e163-413c-93d5-fd783f3bbcd7 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:03.091062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32c17865-e163-413c-93d5-fd783f3bbcd7 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:03.091551 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32c17865-e163-413c-93d5-fd783f3bbcd7 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:03.091988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32c17865-e163-413c-93d5-fd783f3bbcd7 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:03.092687 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32c17865-e163-413c-93d5-fd783f3bbcd7 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:03.093139 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32c17865-e163-413c-93d5-fd783f3bbcd7 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:03.093816 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32c17865-e163-413c-93d5-fd783f3bbcd7 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:03.251537 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-32c17865-e163-413c-93d5-fd783f3bbcd7 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:03.260844 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-32c17865-e163-413c-93d5-fd783f3bbcd7 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1564 microversion: 2.1 time: 0.181906 Sep 01 14:05:03.261451 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 298/621] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:03 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:03.286328 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f54d8578-535d-4a82-8973-26f3f8765553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:03.286863 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f54d8578-535d-4a82-8973-26f3f8765553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:03.293398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f54d8578-535d-4a82-8973-26f3f8765553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:03.293934 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f54d8578-535d-4a82-8973-26f3f8765553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:03.294499 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f54d8578-535d-4a82-8973-26f3f8765553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:03.295145 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f54d8578-535d-4a82-8973-26f3f8765553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:03.295642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f54d8578-535d-4a82-8973-26f3f8765553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:03.296102 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f54d8578-535d-4a82-8973-26f3f8765553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:03.299574 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c9c4fdf8-a3de-4ef0-b447-36e3d3317516 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:03.300130 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c9c4fdf8-a3de-4ef0-b447-36e3d3317516 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:03.307376 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9c4fdf8-a3de-4ef0-b447-36e3d3317516 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:03.307522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9c4fdf8-a3de-4ef0-b447-36e3d3317516 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:03.307938 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9c4fdf8-a3de-4ef0-b447-36e3d3317516 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:03.308866 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9c4fdf8-a3de-4ef0-b447-36e3d3317516 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:03.309321 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9c4fdf8-a3de-4ef0-b447-36e3d3317516 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:03.309754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c9c4fdf8-a3de-4ef0-b447-36e3d3317516 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:03.405803 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c9c4fdf8-a3de-4ef0-b447-36e3d3317516 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:03.420452 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c9c4fdf8-a3de-4ef0-b447-36e3d3317516 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1246 microversion: 2.1 time: 0.124743 Sep 01 14:05:03.421065 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 299/622] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:03 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1246 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:03.436434 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f54d8578-535d-4a82-8973-26f3f8765553 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.154692 Sep 01 14:05:03.437275 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 324/623] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 1 14:05:03 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-interface => generated 285 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:04.444635 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-89b5516d-ba18-4c8f-af21-27308d7dd6ec tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:04.446804 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-89b5516d-ba18-4c8f-af21-27308d7dd6ec tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:04.455872 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-89b5516d-ba18-4c8f-af21-27308d7dd6ec tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:04.457486 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-89b5516d-ba18-4c8f-af21-27308d7dd6ec tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:04.458180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-89b5516d-ba18-4c8f-af21-27308d7dd6ec tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:04.459559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-89b5516d-ba18-4c8f-af21-27308d7dd6ec tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:04.462274 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-89b5516d-ba18-4c8f-af21-27308d7dd6ec tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:04.463010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-89b5516d-ba18-4c8f-af21-27308d7dd6ec tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:04.561562 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-89b5516d-ba18-4c8f-af21-27308d7dd6ec tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:04.573153 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-89b5516d-ba18-4c8f-af21-27308d7dd6ec tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1294 microversion: 2.1 time: 0.133468 Sep 01 14:05:04.574486 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 300/624] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:04 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1294 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:05.392543 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-695a2d58-f0d4-4752-8a58-064f4c382a28 req-8ccccb61-9aa4-4eaa-bf80-7103c4eaba84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901d0282-c949-4f4d-9f04-7141c3b42480", "tag": "79b8068f-760a-42ca-86d8-b6f065560433"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:05.403506 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-695a2d58-f0d4-4752-8a58-064f4c382a28 req-8ccccb61-9aa4-4eaa-bf80-7103c4eaba84 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:05.405124 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-695a2d58-f0d4-4752-8a58-064f4c382a28 req-8ccccb61-9aa4-4eaa-bf80-7103c4eaba84 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:05.405124 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-695a2d58-f0d4-4752-8a58-064f4c382a28 req-8ccccb61-9aa4-4eaa-bf80-7103c4eaba84 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:05.418481 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-695a2d58-f0d4-4752-8a58-064f4c382a28 req-8ccccb61-9aa4-4eaa-bf80-7103c4eaba84 service nova] Creating event network-changed:79b8068f-760a-42ca-86d8-b6f065560433 for instance 901d0282-c949-4f4d-9f04-7141c3b42480 on hv-cinder-85221 Sep 01 14:05:05.426468 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-695a2d58-f0d4-4752-8a58-064f4c382a28 req-8ccccb61-9aa4-4eaa-bf80-7103c4eaba84 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038828 Sep 01 14:05:05.427746 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 325/625] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:05.594709 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-468af34d-ee85-478b-b742-48879d452292 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:05.596144 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-468af34d-ee85-478b-b742-48879d452292 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:05.603474 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468af34d-ee85-478b-b742-48879d452292 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:05.604029 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468af34d-ee85-478b-b742-48879d452292 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:05.604679 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468af34d-ee85-478b-b742-48879d452292 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:05.605617 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468af34d-ee85-478b-b742-48879d452292 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:05.606162 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468af34d-ee85-478b-b742-48879d452292 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:05.606656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468af34d-ee85-478b-b742-48879d452292 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:05.709134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-468af34d-ee85-478b-b742-48879d452292 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:05.725295 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-468af34d-ee85-478b-b742-48879d452292 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1300 microversion: 2.1 time: 0.134906 Sep 01 14:05:05.741867 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 301/626] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:05 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1300 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:06.755538 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-234ad979-bb9b-438a-92f4-401e9ae5d344 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:06.770051 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-234ad979-bb9b-438a-92f4-401e9ae5d344 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:06.777175 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-234ad979-bb9b-438a-92f4-401e9ae5d344 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:06.786101 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-234ad979-bb9b-438a-92f4-401e9ae5d344 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:06.786101 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-234ad979-bb9b-438a-92f4-401e9ae5d344 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:06.786101 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-234ad979-bb9b-438a-92f4-401e9ae5d344 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:06.786101 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-234ad979-bb9b-438a-92f4-401e9ae5d344 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:06.786760 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-234ad979-bb9b-438a-92f4-401e9ae5d344 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:06.912494 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-234ad979-bb9b-438a-92f4-401e9ae5d344 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:06.922858 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-234ad979-bb9b-438a-92f4-401e9ae5d344 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1300 microversion: 2.1 time: 0.172985 Sep 01 14:05:06.939565 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 326/627] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:06 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:07.945257 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d964d5a4-f90b-40a4-82a5-a3d72a8ab294 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:07.945898 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d964d5a4-f90b-40a4-82a5-a3d72a8ab294 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:07.952736 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d964d5a4-f90b-40a4-82a5-a3d72a8ab294 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:07.953224 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d964d5a4-f90b-40a4-82a5-a3d72a8ab294 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:07.953655 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d964d5a4-f90b-40a4-82a5-a3d72a8ab294 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:07.954386 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d964d5a4-f90b-40a4-82a5-a3d72a8ab294 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:07.954835 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d964d5a4-f90b-40a4-82a5-a3d72a8ab294 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:07.955249 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d964d5a4-f90b-40a4-82a5-a3d72a8ab294 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:08.217085 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d964d5a4-f90b-40a4-82a5-a3d72a8ab294 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:08.227822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d964d5a4-f90b-40a4-82a5-a3d72a8ab294 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1368 microversion: 2.1 time: 0.287036 Sep 01 14:05:08.228645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 302/628] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:07 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:08.667966 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-72153d78-d962-4056-95b4-ab0add2af918 req-961ade38-1fd4-4dee-99d7-038f849fc758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f7ccdd-5ecd-4809-b3e7-8ae4295552e9", "tag": "8ead0825-a787-42d8-bd59-6407444b72c6"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:08.685389 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-72153d78-d962-4056-95b4-ab0add2af918 req-961ade38-1fd4-4dee-99d7-038f849fc758 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:08.685837 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-72153d78-d962-4056-95b4-ab0add2af918 req-961ade38-1fd4-4dee-99d7-038f849fc758 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:08.686350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-72153d78-d962-4056-95b4-ab0add2af918 req-961ade38-1fd4-4dee-99d7-038f849fc758 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:08.700530 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-72153d78-d962-4056-95b4-ab0add2af918 req-961ade38-1fd4-4dee-99d7-038f849fc758 service nova] Creating event network-changed:8ead0825-a787-42d8-bd59-6407444b72c6 for instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 on hv-cinder-85221 Sep 01 14:05:08.708465 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-72153d78-d962-4056-95b4-ab0add2af918 req-961ade38-1fd4-4dee-99d7-038f849fc758 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043665 Sep 01 14:05:08.708699 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 327/629] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:05:09.249923 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c400697c-c0c2-4543-a99f-2cfe4fa9f69b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:09.250493 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c400697c-c0c2-4543-a99f-2cfe4fa9f69b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:09.258464 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c400697c-c0c2-4543-a99f-2cfe4fa9f69b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:09.258964 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c400697c-c0c2-4543-a99f-2cfe4fa9f69b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:09.259407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c400697c-c0c2-4543-a99f-2cfe4fa9f69b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:09.260125 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c400697c-c0c2-4543-a99f-2cfe4fa9f69b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:09.260583 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c400697c-c0c2-4543-a99f-2cfe4fa9f69b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:09.261007 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c400697c-c0c2-4543-a99f-2cfe4fa9f69b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:09.481979 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c400697c-c0c2-4543-a99f-2cfe4fa9f69b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:09.490834 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c400697c-c0c2-4543-a99f-2cfe4fa9f69b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1368 microversion: 2.1 time: 0.245908 Sep 01 14:05:09.492073 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 303/630] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:09 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:09.879437 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cf56c525-2b54-4eb2-b6aa-c12348d628fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:09.881738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-cf56c525-2b54-4eb2-b6aa-c12348d628fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:09.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf56c525-2b54-4eb2-b6aa-c12348d628fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:09.909221 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf56c525-2b54-4eb2-b6aa-c12348d628fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:09.909221 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf56c525-2b54-4eb2-b6aa-c12348d628fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:09.909221 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf56c525-2b54-4eb2-b6aa-c12348d628fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:09.909221 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf56c525-2b54-4eb2-b6aa-c12348d628fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:09.909631 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf56c525-2b54-4eb2-b6aa-c12348d628fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:10.171526 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cf56c525-2b54-4eb2-b6aa-c12348d628fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "POST /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/action" status: 202 len: 0 microversion: 2.1 time: 0.297135 Sep 01 14:05:10.172285 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 328/631] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:05:09 2022] POST /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:05:10.181072 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f50415d0-6518-497e-840b-0d5050bd2608 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:10.181626 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f50415d0-6518-497e-840b-0d5050bd2608 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:10.188026 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f50415d0-6518-497e-840b-0d5050bd2608 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:10.188520 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f50415d0-6518-497e-840b-0d5050bd2608 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:10.189017 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f50415d0-6518-497e-840b-0d5050bd2608 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:10.189731 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f50415d0-6518-497e-840b-0d5050bd2608 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:10.190227 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f50415d0-6518-497e-840b-0d5050bd2608 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:10.190657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f50415d0-6518-497e-840b-0d5050bd2608 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:10.441533 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f50415d0-6518-497e-840b-0d5050bd2608 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:10.450267 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f50415d0-6518-497e-840b-0d5050bd2608 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1750 microversion: 2.1 time: 0.273034 Sep 01 14:05:10.452836 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 304/632] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:10 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1750 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:10.514932 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c88825d7-97b0-4a46-ac0d-95ef11d3607e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:10.515628 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c88825d7-97b0-4a46-ac0d-95ef11d3607e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:10.522735 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c88825d7-97b0-4a46-ac0d-95ef11d3607e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:10.523226 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c88825d7-97b0-4a46-ac0d-95ef11d3607e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:10.523662 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c88825d7-97b0-4a46-ac0d-95ef11d3607e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:10.524365 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c88825d7-97b0-4a46-ac0d-95ef11d3607e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:10.524815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c88825d7-97b0-4a46-ac0d-95ef11d3607e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:10.525233 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c88825d7-97b0-4a46-ac0d-95ef11d3607e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:10.682622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c88825d7-97b0-4a46-ac0d-95ef11d3607e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:10.693157 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c88825d7-97b0-4a46-ac0d-95ef11d3607e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1368 microversion: 2.1 time: 0.183613 Sep 01 14:05:10.693744 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 329/633] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:10 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:11.473482 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-be8d98f9-8b63-4846-adc1-f64b609ad20a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:11.474221 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-be8d98f9-8b63-4846-adc1-f64b609ad20a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:11.482625 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be8d98f9-8b63-4846-adc1-f64b609ad20a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:11.484615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be8d98f9-8b63-4846-adc1-f64b609ad20a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:11.486527 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be8d98f9-8b63-4846-adc1-f64b609ad20a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:11.487712 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be8d98f9-8b63-4846-adc1-f64b609ad20a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:11.488972 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be8d98f9-8b63-4846-adc1-f64b609ad20a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:11.489736 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be8d98f9-8b63-4846-adc1-f64b609ad20a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:11.717868 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-719114ca-554d-4e69-a1dd-e2f734b2c9f5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:11.719334 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-719114ca-554d-4e69-a1dd-e2f734b2c9f5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:11.728435 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-719114ca-554d-4e69-a1dd-e2f734b2c9f5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:11.731415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-719114ca-554d-4e69-a1dd-e2f734b2c9f5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:11.733882 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-719114ca-554d-4e69-a1dd-e2f734b2c9f5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:11.734991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-719114ca-554d-4e69-a1dd-e2f734b2c9f5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:11.735683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-719114ca-554d-4e69-a1dd-e2f734b2c9f5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:11.736532 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-719114ca-554d-4e69-a1dd-e2f734b2c9f5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:11.904632 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-be8d98f9-8b63-4846-adc1-f64b609ad20a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:11.924839 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-be8d98f9-8b63-4846-adc1-f64b609ad20a tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1750 microversion: 2.1 time: 0.456006 Sep 01 14:05:11.927486 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 305/634] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:11 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1750 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:12.150685 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-719114ca-554d-4e69-a1dd-e2f734b2c9f5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:12.158709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-719114ca-554d-4e69-a1dd-e2f734b2c9f5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1368 microversion: 2.1 time: 0.444854 Sep 01 14:05:12.159278 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 330/635] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:11 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1368 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:12.950265 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-aeaf76f6-c19f-4f2b-967c-6fe15a5d022e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:12.951630 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-aeaf76f6-c19f-4f2b-967c-6fe15a5d022e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:12.954265 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:12.954948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=10 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:12.960867 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aeaf76f6-c19f-4f2b-967c-6fe15a5d022e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:12.961365 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aeaf76f6-c19f-4f2b-967c-6fe15a5d022e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:12.961850 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aeaf76f6-c19f-4f2b-967c-6fe15a5d022e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:12.962564 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aeaf76f6-c19f-4f2b-967c-6fe15a5d022e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:12.963021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aeaf76f6-c19f-4f2b-967c-6fe15a5d022e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:12.963447 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aeaf76f6-c19f-4f2b-967c-6fe15a5d022e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:13.181130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-635b2a65-7810-4a0e-9e9b-ab3cf82d8848 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:13.182474 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-635b2a65-7810-4a0e-9e9b-ab3cf82d8848 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:13.184473 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:13.190829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-635b2a65-7810-4a0e-9e9b-ab3cf82d8848 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:13.191209 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-635b2a65-7810-4a0e-9e9b-ab3cf82d8848 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:13.191839 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-635b2a65-7810-4a0e-9e9b-ab3cf82d8848 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:13.192719 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-635b2a65-7810-4a0e-9e9b-ab3cf82d8848 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:13.193432 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-635b2a65-7810-4a0e-9e9b-ab3cf82d8848 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:13.193992 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-635b2a65-7810-4a0e-9e9b-ab3cf82d8848 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:13.237351 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-aeaf76f6-c19f-4f2b-967c-6fe15a5d022e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:13.246260 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-aeaf76f6-c19f-4f2b-967c-6fe15a5d022e tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.299960 Sep 01 14:05:13.246942 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 306/636] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:12 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:13.448257 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-635b2a65-7810-4a0e-9e9b-ab3cf82d8848 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:13.456521 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-635b2a65-7810-4a0e-9e9b-ab3cf82d8848 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1368 microversion: 2.1 time: 0.279556 Sep 01 14:05:13.469986 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 331/637] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:13 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:14.268633 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ee20d10e-1b19-4453-a149-60c5ca9c5732 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:14.269417 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ee20d10e-1b19-4453-a149-60c5ca9c5732 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:14.276034 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee20d10e-1b19-4453-a149-60c5ca9c5732 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:14.276520 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee20d10e-1b19-4453-a149-60c5ca9c5732 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:14.276957 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee20d10e-1b19-4453-a149-60c5ca9c5732 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:14.277662 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee20d10e-1b19-4453-a149-60c5ca9c5732 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:14.278431 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee20d10e-1b19-4453-a149-60c5ca9c5732 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:14.279048 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee20d10e-1b19-4453-a149-60c5ca9c5732 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:14.443605 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ee20d10e-1b19-4453-a149-60c5ca9c5732 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:14.452592 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ee20d10e-1b19-4453-a149-60c5ca9c5732 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.187876 Sep 01 14:05:14.453438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 307/638] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:14 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:14.479276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5c29b4c0-03b1-4b3b-9b13-26a1f9b10340 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:14.480072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-5c29b4c0-03b1-4b3b-9b13-26a1f9b10340 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:14.487779 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5c29b4c0-03b1-4b3b-9b13-26a1f9b10340 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:14.488377 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5c29b4c0-03b1-4b3b-9b13-26a1f9b10340 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:14.488919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5c29b4c0-03b1-4b3b-9b13-26a1f9b10340 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:14.489732 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5c29b4c0-03b1-4b3b-9b13-26a1f9b10340 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:14.490367 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5c29b4c0-03b1-4b3b-9b13-26a1f9b10340 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:14.490978 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5c29b4c0-03b1-4b3b-9b13-26a1f9b10340 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:14.628815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5c29b4c0-03b1-4b3b-9b13-26a1f9b10340 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:14.636679 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-5c29b4c0-03b1-4b3b-9b13-26a1f9b10340 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1368 microversion: 2.1 time: 0.161243 Sep 01 14:05:14.637260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 332/639] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:14 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:15.475484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-fa640ff9-3a9d-40e4-8110-701f102a1543 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:15.477042 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fa640ff9-3a9d-40e4-8110-701f102a1543 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:15.484206 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fa640ff9-3a9d-40e4-8110-701f102a1543 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:15.484987 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fa640ff9-3a9d-40e4-8110-701f102a1543 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:15.485637 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fa640ff9-3a9d-40e4-8110-701f102a1543 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:15.486840 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fa640ff9-3a9d-40e4-8110-701f102a1543 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:15.489309 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fa640ff9-3a9d-40e4-8110-701f102a1543 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:15.489998 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fa640ff9-3a9d-40e4-8110-701f102a1543 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:15.657509 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0c64a660-6130-4a28-84a9-a196c572ac88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:15.658159 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0c64a660-6130-4a28-84a9-a196c572ac88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:15.668306 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fa640ff9-3a9d-40e4-8110-701f102a1543 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:15.668535 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c64a660-6130-4a28-84a9-a196c572ac88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:15.669044 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c64a660-6130-4a28-84a9-a196c572ac88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:15.669490 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c64a660-6130-4a28-84a9-a196c572ac88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:15.671784 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c64a660-6130-4a28-84a9-a196c572ac88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:15.672262 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c64a660-6130-4a28-84a9-a196c572ac88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:15.672711 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c64a660-6130-4a28-84a9-a196c572ac88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:15.680412 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-fa640ff9-3a9d-40e4-8110-701f102a1543 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.209353 Sep 01 14:05:15.681563 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 308/640] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:15 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:15.814956 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0c64a660-6130-4a28-84a9-a196c572ac88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:15.823594 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0c64a660-6130-4a28-84a9-a196c572ac88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1368 microversion: 2.1 time: 0.170030 Sep 01 14:05:15.824171 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 333/641] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:15 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:15.945698 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-58fdf3b0-2b5f-4816-9f79-2b29ab122269 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Action: 'create', calling method: .version_select at 0x7f1afd2175e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1757307735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3gkCIrMGSPB/yKtVDTvVMZ9mogW2RBvweFPyAZRkJ+SGDWIfhHbpHTE/G9d8+gIPGd5wffXX8zP8meIY0l4MB9uuR3OaEaOMlYMJpuyoVZPvYI5ovUfeYnWgeH4gw4pw=="}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:15.960596 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-58fdf3b0-2b5f-4816-9f79-2b29ab122269 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Getting quotas for project 9086ba5c610d4954a238d6569ec32f0b. Resources: {'key_pairs'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:05:15.964457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-58fdf3b0-2b5f-4816-9f79-2b29ab122269 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Getting quotas for user 748b8b4771ac498a88fdd98c8a4914ad and project 9086ba5c610d4954a238d6569ec32f0b. Resources: {'key_pairs'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:05:16.071039 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-58fdf3b0-2b5f-4816-9f79-2b29ab122269 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.304387 Sep 01 14:05:16.071588 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 309/642] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 1 14:05:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:05:16.551503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-b0fecb7a-4b05-4404-92e1-34fd48abe6d0 req-781d558e-9f90-475d-bc2c-e754c2b6b56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f7ccdd-5ecd-4809-b3e7-8ae4295552e9", "name": "network-vif-plugged", "status": "completed", "tag": "8ead0825-a787-42d8-bd59-6407444b72c6"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:16.563443 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-b0fecb7a-4b05-4404-92e1-34fd48abe6d0 req-781d558e-9f90-475d-bc2c-e754c2b6b56a service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:16.564107 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-b0fecb7a-4b05-4404-92e1-34fd48abe6d0 req-781d558e-9f90-475d-bc2c-e754c2b6b56a service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:16.564675 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-b0fecb7a-4b05-4404-92e1-34fd48abe6d0 req-781d558e-9f90-475d-bc2c-e754c2b6b56a service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:16.575672 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-b0fecb7a-4b05-4404-92e1-34fd48abe6d0 req-781d558e-9f90-475d-bc2c-e754c2b6b56a service nova] Creating event network-vif-plugged:8ead0825-a787-42d8-bd59-6407444b72c6 for instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 on hv-cinder-85221 Sep 01 14:05:16.580708 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-b0fecb7a-4b05-4404-92e1-34fd48abe6d0 req-781d558e-9f90-475d-bc2c-e754c2b6b56a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034807 Sep 01 14:05:16.581412 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 334/643] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:16.703432 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4ea4f7ed-f1e2-4801-8cea-ed919847f36c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:16.704110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4ea4f7ed-f1e2-4801-8cea-ed919847f36c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:16.712474 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4ea4f7ed-f1e2-4801-8cea-ed919847f36c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:16.713115 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4ea4f7ed-f1e2-4801-8cea-ed919847f36c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:16.715776 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4ea4f7ed-f1e2-4801-8cea-ed919847f36c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:16.715776 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4ea4f7ed-f1e2-4801-8cea-ed919847f36c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:16.715776 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4ea4f7ed-f1e2-4801-8cea-ed919847f36c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:16.715776 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4ea4f7ed-f1e2-4801-8cea-ed919847f36c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:16.848026 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0c9c6232-0deb-45bc-bd8e-1d0cadfda50b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:16.849955 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0c9c6232-0deb-45bc-bd8e-1d0cadfda50b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:16.857429 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c9c6232-0deb-45bc-bd8e-1d0cadfda50b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:16.858107 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c9c6232-0deb-45bc-bd8e-1d0cadfda50b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:16.858442 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c9c6232-0deb-45bc-bd8e-1d0cadfda50b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:16.859162 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c9c6232-0deb-45bc-bd8e-1d0cadfda50b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:16.859612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c9c6232-0deb-45bc-bd8e-1d0cadfda50b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:16.860038 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0c9c6232-0deb-45bc-bd8e-1d0cadfda50b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:16.950916 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4ea4f7ed-f1e2-4801-8cea-ed919847f36c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:16.969144 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4ea4f7ed-f1e2-4801-8cea-ed919847f36c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.270331 Sep 01 14:05:16.970091 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 310/644] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:16 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:17.081184 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0c9c6232-0deb-45bc-bd8e-1d0cadfda50b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:17.088592 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0c9c6232-0deb-45bc-bd8e-1d0cadfda50b tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1368 microversion: 2.1 time: 0.247622 Sep 01 14:05:17.089142 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 335/645] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:16 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:17.991604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-94ce70b2-a683-4c49-bfa0-4d39ad8f6ac8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:17.992319 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-94ce70b2-a683-4c49-bfa0-4d39ad8f6ac8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:17.999044 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-94ce70b2-a683-4c49-bfa0-4d39ad8f6ac8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:17.999618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-94ce70b2-a683-4c49-bfa0-4d39ad8f6ac8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:18.000390 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-94ce70b2-a683-4c49-bfa0-4d39ad8f6ac8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:18.001170 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-94ce70b2-a683-4c49-bfa0-4d39ad8f6ac8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:18.001630 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-94ce70b2-a683-4c49-bfa0-4d39ad8f6ac8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:18.002122 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-94ce70b2-a683-4c49-bfa0-4d39ad8f6ac8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:18.109855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d99171c3-fc1d-4fa0-8b67-4ed2c55ea0c5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:18.110630 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d99171c3-fc1d-4fa0-8b67-4ed2c55ea0c5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:18.117591 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d99171c3-fc1d-4fa0-8b67-4ed2c55ea0c5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:18.118104 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d99171c3-fc1d-4fa0-8b67-4ed2c55ea0c5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:18.118532 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d99171c3-fc1d-4fa0-8b67-4ed2c55ea0c5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:18.119246 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d99171c3-fc1d-4fa0-8b67-4ed2c55ea0c5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:18.119889 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d99171c3-fc1d-4fa0-8b67-4ed2c55ea0c5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:18.120577 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d99171c3-fc1d-4fa0-8b67-4ed2c55ea0c5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:18.173343 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-94ce70b2-a683-4c49-bfa0-4d39ad8f6ac8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:18.182536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-94ce70b2-a683-4c49-bfa0-4d39ad8f6ac8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.195552 Sep 01 14:05:18.183114 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 311/646] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:17 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:18.271169 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d99171c3-fc1d-4fa0-8b67-4ed2c55ea0c5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:18.279799 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d99171c3-fc1d-4fa0-8b67-4ed2c55ea0c5 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1368 microversion: 2.1 time: 0.173882 Sep 01 14:05:18.281908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 336/647] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:18 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:19.204351 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8f9dbd7b-3a98-4f21-b8b1-455d04f5c577 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:19.205236 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8f9dbd7b-3a98-4f21-b8b1-455d04f5c577 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:19.212237 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8f9dbd7b-3a98-4f21-b8b1-455d04f5c577 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:19.212732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8f9dbd7b-3a98-4f21-b8b1-455d04f5c577 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:19.213172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8f9dbd7b-3a98-4f21-b8b1-455d04f5c577 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:19.213919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8f9dbd7b-3a98-4f21-b8b1-455d04f5c577 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:19.214377 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8f9dbd7b-3a98-4f21-b8b1-455d04f5c577 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:19.216033 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8f9dbd7b-3a98-4f21-b8b1-455d04f5c577 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:19.304422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cbbe9101-a6b6-42b6-91f9-cae3ca7f401e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:19.305034 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-cbbe9101-a6b6-42b6-91f9-cae3ca7f401e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:19.318071 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cbbe9101-a6b6-42b6-91f9-cae3ca7f401e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:19.318569 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cbbe9101-a6b6-42b6-91f9-cae3ca7f401e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:19.319007 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cbbe9101-a6b6-42b6-91f9-cae3ca7f401e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:19.319849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cbbe9101-a6b6-42b6-91f9-cae3ca7f401e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:19.320471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cbbe9101-a6b6-42b6-91f9-cae3ca7f401e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:19.320901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cbbe9101-a6b6-42b6-91f9-cae3ca7f401e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:19.406289 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8f9dbd7b-3a98-4f21-b8b1-455d04f5c577 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:19.410513 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:19.417715 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8f9dbd7b-3a98-4f21-b8b1-455d04f5c577 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.217184 Sep 01 14:05:19.427607 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 312/648] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:19 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:19.482264 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cbbe9101-a6b6-42b6-91f9-cae3ca7f401e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:19.491760 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cbbe9101-a6b6-42b6-91f9-cae3ca7f401e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1559 microversion: 2.1 time: 0.192641 Sep 01 14:05:19.492347 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 337/649] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:19 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:19.517443 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-857120f1-b36a-488a-b914-6c25a593e18e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:19.518247 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-857120f1-b36a-488a-b914-6c25a593e18e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:19.526614 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-857120f1-b36a-488a-b914-6c25a593e18e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:19.527105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-857120f1-b36a-488a-b914-6c25a593e18e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:19.527733 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-857120f1-b36a-488a-b914-6c25a593e18e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:19.528620 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-857120f1-b36a-488a-b914-6c25a593e18e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:19.529080 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-857120f1-b36a-488a-b914-6c25a593e18e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:19.529508 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-857120f1-b36a-488a-b914-6c25a593e18e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:19.607775 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-857120f1-b36a-488a-b914-6c25a593e18e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096240 Sep 01 14:05:19.608370 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 313/650] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 1 14:05:19 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:20.443436 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5b6f32f2-3a25-4cfe-bf9d-220cd6778cc9 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:20.444384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-5b6f32f2-3a25-4cfe-bf9d-220cd6778cc9 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:20.451297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5b6f32f2-3a25-4cfe-bf9d-220cd6778cc9 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:20.451787 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5b6f32f2-3a25-4cfe-bf9d-220cd6778cc9 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:20.452425 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5b6f32f2-3a25-4cfe-bf9d-220cd6778cc9 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:20.453316 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5b6f32f2-3a25-4cfe-bf9d-220cd6778cc9 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:20.453982 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5b6f32f2-3a25-4cfe-bf9d-220cd6778cc9 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:20.454408 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5b6f32f2-3a25-4cfe-bf9d-220cd6778cc9 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:20.749490 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5b6f32f2-3a25-4cfe-bf9d-220cd6778cc9 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:20.761304 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-5b6f32f2-3a25-4cfe-bf9d-220cd6778cc9 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.322738 Sep 01 14:05:20.762203 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 338/651] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:20 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:21.039401 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-9a5fc74d-53fd-408a-bc33-1085f8919023 req-fd76c5f0-6aae-4c41-8fd7-cb0359faa790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f7ccdd-5ecd-4809-b3e7-8ae4295552e9", "tag": "8ead0825-a787-42d8-bd59-6407444b72c6"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:21.049133 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-9a5fc74d-53fd-408a-bc33-1085f8919023 req-fd76c5f0-6aae-4c41-8fd7-cb0359faa790 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:21.049615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-9a5fc74d-53fd-408a-bc33-1085f8919023 req-fd76c5f0-6aae-4c41-8fd7-cb0359faa790 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:21.050927 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-9a5fc74d-53fd-408a-bc33-1085f8919023 req-fd76c5f0-6aae-4c41-8fd7-cb0359faa790 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:21.062027 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-9a5fc74d-53fd-408a-bc33-1085f8919023 req-fd76c5f0-6aae-4c41-8fd7-cb0359faa790 service nova] Creating event network-changed:8ead0825-a787-42d8-bd59-6407444b72c6 for instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 on hv-cinder-85221 Sep 01 14:05:21.067247 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-9a5fc74d-53fd-408a-bc33-1085f8919023 req-fd76c5f0-6aae-4c41-8fd7-cb0359faa790 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032490 Sep 01 14:05:21.068045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 314/652] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:21.782603 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9b8b9906-901d-4a1a-8ed0-dad4ccc3e09f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:21.783190 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9b8b9906-901d-4a1a-8ed0-dad4ccc3e09f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:21.789298 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b8b9906-901d-4a1a-8ed0-dad4ccc3e09f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:21.797317 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b8b9906-901d-4a1a-8ed0-dad4ccc3e09f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:21.797317 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b8b9906-901d-4a1a-8ed0-dad4ccc3e09f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:21.797317 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b8b9906-901d-4a1a-8ed0-dad4ccc3e09f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:21.797317 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b8b9906-901d-4a1a-8ed0-dad4ccc3e09f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:21.797642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b8b9906-901d-4a1a-8ed0-dad4ccc3e09f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:21.958054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9b8b9906-901d-4a1a-8ed0-dad4ccc3e09f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:21.966665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9b8b9906-901d-4a1a-8ed0-dad4ccc3e09f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.187989 Sep 01 14:05:21.967530 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 339/653] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:21 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:22.989371 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6201d5c4-2ecf-4904-8472-f3e3d7d8972f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:22.990015 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-6201d5c4-2ecf-4904-8472-f3e3d7d8972f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:22.996146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6201d5c4-2ecf-4904-8472-f3e3d7d8972f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:22.996630 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6201d5c4-2ecf-4904-8472-f3e3d7d8972f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:22.997070 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6201d5c4-2ecf-4904-8472-f3e3d7d8972f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:22.997795 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6201d5c4-2ecf-4904-8472-f3e3d7d8972f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:22.998260 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6201d5c4-2ecf-4904-8472-f3e3d7d8972f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:22.998686 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6201d5c4-2ecf-4904-8472-f3e3d7d8972f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:23.148678 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-6201d5c4-2ecf-4904-8472-f3e3d7d8972f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:23.156737 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6201d5c4-2ecf-4904-8472-f3e3d7d8972f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.172249 Sep 01 14:05:23.157315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 315/654] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:22 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:24.178110 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ff6fe32c-b1c5-41f4-b72f-ea2dadd88d73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:24.178713 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ff6fe32c-b1c5-41f4-b72f-ea2dadd88d73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:24.185291 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ff6fe32c-b1c5-41f4-b72f-ea2dadd88d73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:24.185676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ff6fe32c-b1c5-41f4-b72f-ea2dadd88d73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:24.186148 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ff6fe32c-b1c5-41f4-b72f-ea2dadd88d73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:24.186858 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ff6fe32c-b1c5-41f4-b72f-ea2dadd88d73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:24.187313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ff6fe32c-b1c5-41f4-b72f-ea2dadd88d73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:24.187786 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ff6fe32c-b1c5-41f4-b72f-ea2dadd88d73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:24.204602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:24.334718 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ff6fe32c-b1c5-41f4-b72f-ea2dadd88d73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:24.342688 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ff6fe32c-b1c5-41f4-b72f-ea2dadd88d73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.168589 Sep 01 14:05:24.343245 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 340/655] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:24 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:25.365269 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-20f3d615-4d8e-4fcf-9a5e-bb3641f0c9fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:25.365956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-20f3d615-4d8e-4fcf-9a5e-bb3641f0c9fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:25.372346 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-20f3d615-4d8e-4fcf-9a5e-bb3641f0c9fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:25.372828 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-20f3d615-4d8e-4fcf-9a5e-bb3641f0c9fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:25.373273 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-20f3d615-4d8e-4fcf-9a5e-bb3641f0c9fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:25.373999 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-20f3d615-4d8e-4fcf-9a5e-bb3641f0c9fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:25.374454 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-20f3d615-4d8e-4fcf-9a5e-bb3641f0c9fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:25.375136 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-20f3d615-4d8e-4fcf-9a5e-bb3641f0c9fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:25.522900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-20f3d615-4d8e-4fcf-9a5e-bb3641f0c9fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:25.531248 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-20f3d615-4d8e-4fcf-9a5e-bb3641f0c9fd tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.170516 Sep 01 14:05:25.531822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 316/656] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:25 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:26.552739 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-548ff2a7-e3f2-4582-a1cf-2bc29fc989e4 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:26.553380 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-548ff2a7-e3f2-4582-a1cf-2bc29fc989e4 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:26.560024 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-548ff2a7-e3f2-4582-a1cf-2bc29fc989e4 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:26.560505 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-548ff2a7-e3f2-4582-a1cf-2bc29fc989e4 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:26.560960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-548ff2a7-e3f2-4582-a1cf-2bc29fc989e4 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:26.561653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-548ff2a7-e3f2-4582-a1cf-2bc29fc989e4 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:26.562132 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-548ff2a7-e3f2-4582-a1cf-2bc29fc989e4 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:26.562550 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-548ff2a7-e3f2-4582-a1cf-2bc29fc989e4 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:26.719230 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-548ff2a7-e3f2-4582-a1cf-2bc29fc989e4 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:26.731801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-548ff2a7-e3f2-4582-a1cf-2bc29fc989e4 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.182902 Sep 01 14:05:26.732394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 341/657] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:26 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:27.311606 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-aba97ed2-758d-4f66-88bc-46c982f8c2e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:27.312121 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-aba97ed2-758d-4f66-88bc-46c982f8c2e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:27.314018 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=4 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:27.320116 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aba97ed2-758d-4f66-88bc-46c982f8c2e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:27.320587 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aba97ed2-758d-4f66-88bc-46c982f8c2e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:27.321030 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aba97ed2-758d-4f66-88bc-46c982f8c2e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:27.321734 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aba97ed2-758d-4f66-88bc-46c982f8c2e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:27.322216 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aba97ed2-758d-4f66-88bc-46c982f8c2e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:27.326682 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-aba97ed2-758d-4f66-88bc-46c982f8c2e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:27.352472 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-aba97ed2-758d-4f66-88bc-46c982f8c2e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-volume_attachments/29cab155-6470-43a3-9892-66b944bf432f" status: 200 len: 194 microversion: 2.20 time: 0.045108 Sep 01 14:05:27.353135 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 317/658] 10.222.0.61 () {60 vars in 1454 bytes} [Thu Sep 1 14:05:27 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-volume_attachments/29cab155-6470-43a3-9892-66b944bf432f => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:05:27.420685 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d07e8699-297e-426a-8c65-6216f7b1fc85 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:27.423981 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d07e8699-297e-426a-8c65-6216f7b1fc85 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:27.423981 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=53 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:27.428670 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d07e8699-297e-426a-8c65-6216f7b1fc85 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:27.429157 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d07e8699-297e-426a-8c65-6216f7b1fc85 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:27.429598 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d07e8699-297e-426a-8c65-6216f7b1fc85 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:27.430399 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d07e8699-297e-426a-8c65-6216f7b1fc85 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:27.430857 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d07e8699-297e-426a-8c65-6216f7b1fc85 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:27.431287 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d07e8699-297e-426a-8c65-6216f7b1fc85 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:27.513731 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-d07e8699-297e-426a-8c65-6216f7b1fc85 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lazy-loading 'services' on Instance uuid 0bac5a33-d73f-48a4-bead-fcf039becf3a {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:05:27.715229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d07e8699-297e-426a-8c65-6216f7b1fc85 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-volume_attachments/29cab155-6470-43a3-9892-66b944bf432f" status: 202 len: 0 microversion: 2.20 time: 0.298474 Sep 01 14:05:27.715900 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 342/659] 10.222.0.61 () {60 vars in 1457 bytes} [Thu Sep 1 14:05:27 2022] DELETE /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-volume_attachments/29cab155-6470-43a3-9892-66b944bf432f => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:05:27.724788 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-cfdc498e-9270-4adc-b0f0-c0889004b3b6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:27.726946 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-cfdc498e-9270-4adc-b0f0-c0889004b3b6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:27.732887 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cfdc498e-9270-4adc-b0f0-c0889004b3b6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:27.733368 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cfdc498e-9270-4adc-b0f0-c0889004b3b6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:27.733841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cfdc498e-9270-4adc-b0f0-c0889004b3b6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:27.734539 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cfdc498e-9270-4adc-b0f0-c0889004b3b6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:27.734986 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cfdc498e-9270-4adc-b0f0-c0889004b3b6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:27.735407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cfdc498e-9270-4adc-b0f0-c0889004b3b6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:27.753915 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-dd6b734a-c30d-47a3-a475-d378720f835d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:27.754615 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-dd6b734a-c30d-47a3-a475-d378720f835d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:27.761462 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dd6b734a-c30d-47a3-a475-d378720f835d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:27.761985 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dd6b734a-c30d-47a3-a475-d378720f835d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:27.762435 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dd6b734a-c30d-47a3-a475-d378720f835d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:27.763162 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dd6b734a-c30d-47a3-a475-d378720f835d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:27.763615 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dd6b734a-c30d-47a3-a475-d378720f835d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:27.764470 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dd6b734a-c30d-47a3-a475-d378720f835d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:27.776953 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-cfdc498e-9270-4adc-b0f0-c0889004b3b6 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056473 Sep 01 14:05:27.778639 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 318/660] 10.222.0.61 () {60 vars in 1343 bytes} [Thu Sep 1 14:05:27 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:05:27.940592 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-dd6b734a-c30d-47a3-a475-d378720f835d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:27.949056 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-dd6b734a-c30d-47a3-a475-d378720f835d tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.199734 Sep 01 14:05:27.949626 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 343/661] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:27 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:28.791462 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-766ff7e1-f5bf-4264-8f15-5629f0001213 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:28.793626 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-766ff7e1-f5bf-4264-8f15-5629f0001213 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:28.800089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-766ff7e1-f5bf-4264-8f15-5629f0001213 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:28.800592 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-766ff7e1-f5bf-4264-8f15-5629f0001213 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:28.801033 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-766ff7e1-f5bf-4264-8f15-5629f0001213 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:28.801729 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-766ff7e1-f5bf-4264-8f15-5629f0001213 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:28.802212 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-766ff7e1-f5bf-4264-8f15-5629f0001213 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:28.802647 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-766ff7e1-f5bf-4264-8f15-5629f0001213 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:28.834273 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-766ff7e1-f5bf-4264-8f15-5629f0001213 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046753 Sep 01 14:05:28.834845 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 319/662] 10.222.0.61 () {60 vars in 1343 bytes} [Thu Sep 1 14:05:28 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 14:05:28.971066 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-36d6e792-48c8-4721-9aba-eb4b20973c43 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:28.971707 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-36d6e792-48c8-4721-9aba-eb4b20973c43 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:28.978804 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36d6e792-48c8-4721-9aba-eb4b20973c43 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:28.979290 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36d6e792-48c8-4721-9aba-eb4b20973c43 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:28.979720 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36d6e792-48c8-4721-9aba-eb4b20973c43 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:28.980406 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36d6e792-48c8-4721-9aba-eb4b20973c43 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:28.980856 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36d6e792-48c8-4721-9aba-eb4b20973c43 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:28.981280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36d6e792-48c8-4721-9aba-eb4b20973c43 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:29.131006 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-36d6e792-48c8-4721-9aba-eb4b20973c43 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:29.139391 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-36d6e792-48c8-4721-9aba-eb4b20973c43 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1755 microversion: 2.1 time: 0.172107 Sep 01 14:05:29.139972 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 344/663] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:28 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:29.846811 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-468ae623-b3b5-40c2-b869-f771d0dde53f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:29.849436 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-468ae623-b3b5-40c2-b869-f771d0dde53f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:29.858955 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468ae623-b3b5-40c2-b869-f771d0dde53f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:29.859535 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468ae623-b3b5-40c2-b869-f771d0dde53f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:29.860493 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468ae623-b3b5-40c2-b869-f771d0dde53f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:29.861054 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468ae623-b3b5-40c2-b869-f771d0dde53f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:29.861610 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468ae623-b3b5-40c2-b869-f771d0dde53f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:29.862137 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468ae623-b3b5-40c2-b869-f771d0dde53f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:29.896398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-468ae623-b3b5-40c2-b869-f771d0dde53f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053289 Sep 01 14:05:29.896807 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 320/664] 10.222.0.61 () {60 vars in 1343 bytes} [Thu Sep 1 14:05:29 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:29.960885 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ec62cde7-162e-4f06-b7b7-1a7b563634db tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:29.961375 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ec62cde7-162e-4f06-b7b7-1a7b563634db tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:29.967297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ec62cde7-162e-4f06-b7b7-1a7b563634db tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:29.969493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ec62cde7-162e-4f06-b7b7-1a7b563634db tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:29.969493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ec62cde7-162e-4f06-b7b7-1a7b563634db tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:29.969493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ec62cde7-162e-4f06-b7b7-1a7b563634db tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:29.969493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ec62cde7-162e-4f06-b7b7-1a7b563634db tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:29.969845 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ec62cde7-162e-4f06-b7b7-1a7b563634db tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:29.996932 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ec62cde7-162e-4f06-b7b7-1a7b563634db tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Going to try to terminate instance {{(pid=127811) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:05:30.162388 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-95b17dd0-ac70-494a-915c-5ba2b73c3af2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:30.163065 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-95b17dd0-ac70-494a-915c-5ba2b73c3af2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:30.170334 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-95b17dd0-ac70-494a-915c-5ba2b73c3af2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:30.170334 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-95b17dd0-ac70-494a-915c-5ba2b73c3af2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:30.170948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-95b17dd0-ac70-494a-915c-5ba2b73c3af2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:30.171711 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-95b17dd0-ac70-494a-915c-5ba2b73c3af2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:30.172312 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-95b17dd0-ac70-494a-915c-5ba2b73c3af2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:30.172604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-95b17dd0-ac70-494a-915c-5ba2b73c3af2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:30.299156 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ec62cde7-162e-4f06-b7b7-1a7b563634db tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 204 len: 0 microversion: 2.20 time: 0.341859 Sep 01 14:05:30.299931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 345/665] 10.222.0.61 () {60 vars in 1280 bytes} [Thu Sep 1 14:05:29 2022] DELETE /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 14:05:30.308652 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e64a6902-cfc4-46d0-919e-74b083028f72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:30.309870 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e64a6902-cfc4-46d0-919e-74b083028f72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:30.318686 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e64a6902-cfc4-46d0-919e-74b083028f72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:30.319282 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e64a6902-cfc4-46d0-919e-74b083028f72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:30.319936 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e64a6902-cfc4-46d0-919e-74b083028f72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:30.320752 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-95b17dd0-ac70-494a-915c-5ba2b73c3af2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:30.320903 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e64a6902-cfc4-46d0-919e-74b083028f72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:30.321315 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e64a6902-cfc4-46d0-919e-74b083028f72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:30.321741 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e64a6902-cfc4-46d0-919e-74b083028f72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:30.329181 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-95b17dd0-ac70-494a-915c-5ba2b73c3af2 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1758 microversion: 2.1 time: 0.171259 Sep 01 14:05:30.330943 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 321/666] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:30 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:30.463881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e64a6902-cfc4-46d0-919e-74b083028f72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:30.471860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e64a6902-cfc4-46d0-919e-74b083028f72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:30.473292 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e64a6902-cfc4-46d0-919e-74b083028f72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:30.474457 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e64a6902-cfc4-46d0-919e-74b083028f72 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.170235 Sep 01 14:05:30.475017 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 346/667] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:30 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:05:31.497385 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-994d6d0c-c35a-47a6-b706-024eabb7ea80 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:31.498019 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-994d6d0c-c35a-47a6-b706-024eabb7ea80 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:31.504616 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-994d6d0c-c35a-47a6-b706-024eabb7ea80 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:31.505093 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-994d6d0c-c35a-47a6-b706-024eabb7ea80 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:31.505525 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-994d6d0c-c35a-47a6-b706-024eabb7ea80 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:31.506239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-994d6d0c-c35a-47a6-b706-024eabb7ea80 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:31.506706 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-994d6d0c-c35a-47a6-b706-024eabb7ea80 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:31.507124 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-994d6d0c-c35a-47a6-b706-024eabb7ea80 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:31.743350 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-994d6d0c-c35a-47a6-b706-024eabb7ea80 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:31.751620 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-994d6d0c-c35a-47a6-b706-024eabb7ea80 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:31.753052 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-994d6d0c-c35a-47a6-b706-024eabb7ea80 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:31.754238 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-994d6d0c-c35a-47a6-b706-024eabb7ea80 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.260777 Sep 01 14:05:31.754794 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 322/668] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:31 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:32.777589 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-250b3290-20f0-43f2-9a8f-08b508b0c1f1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:32.778275 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-250b3290-20f0-43f2-9a8f-08b508b0c1f1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:32.784686 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-250b3290-20f0-43f2-9a8f-08b508b0c1f1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:32.785176 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-250b3290-20f0-43f2-9a8f-08b508b0c1f1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:32.785615 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-250b3290-20f0-43f2-9a8f-08b508b0c1f1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:32.786332 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-250b3290-20f0-43f2-9a8f-08b508b0c1f1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:32.786786 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-250b3290-20f0-43f2-9a8f-08b508b0c1f1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:32.787315 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-250b3290-20f0-43f2-9a8f-08b508b0c1f1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:33.096338 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-250b3290-20f0-43f2-9a8f-08b508b0c1f1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:33.104382 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-250b3290-20f0-43f2-9a8f-08b508b0c1f1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:33.105903 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-250b3290-20f0-43f2-9a8f-08b508b0c1f1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:33.107098 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-250b3290-20f0-43f2-9a8f-08b508b0c1f1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1721 microversion: 2.20 time: 0.334471 Sep 01 14:05:33.107656 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 347/669] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:32 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1721 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:34.096990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-ac8a0fe3-83a3-411d-a35f-13e1296b6215 req-301f956c-41d0-458e-9da8-19847a77bb05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bac5a33-d73f-48a4-bead-fcf039becf3a", "name": "network-vif-deleted", "tag": "aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:34.103110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:34.108760 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ac8a0fe3-83a3-411d-a35f-13e1296b6215 req-301f956c-41d0-458e-9da8-19847a77bb05 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:34.109434 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ac8a0fe3-83a3-411d-a35f-13e1296b6215 req-301f956c-41d0-458e-9da8-19847a77bb05 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:34.109934 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ac8a0fe3-83a3-411d-a35f-13e1296b6215 req-301f956c-41d0-458e-9da8-19847a77bb05 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:34.122956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-ac8a0fe3-83a3-411d-a35f-13e1296b6215 req-301f956c-41d0-458e-9da8-19847a77bb05 service nova] Creating event network-vif-deleted:aa0ae8eb-a68b-493f-bf0c-0c78fd9b8025 for instance 0bac5a33-d73f-48a4-bead-fcf039becf3a on hv-cinder-85221 Sep 01 14:05:34.128588 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-ac8a0fe3-83a3-411d-a35f-13e1296b6215 req-301f956c-41d0-458e-9da8-19847a77bb05 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036087 Sep 01 14:05:34.129158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 323/670] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:05:34.134415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7771c1d9-f2b9-40a8-9296-d0b3a659e04e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:34.135025 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7771c1d9-f2b9-40a8-9296-d0b3a659e04e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:34.148390 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7771c1d9-f2b9-40a8-9296-d0b3a659e04e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:34.148390 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7771c1d9-f2b9-40a8-9296-d0b3a659e04e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:34.148390 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7771c1d9-f2b9-40a8-9296-d0b3a659e04e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:34.148390 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7771c1d9-f2b9-40a8-9296-d0b3a659e04e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:34.148807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7771c1d9-f2b9-40a8-9296-d0b3a659e04e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:34.148807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7771c1d9-f2b9-40a8-9296-d0b3a659e04e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:34.212702 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7771c1d9-f2b9-40a8-9296-d0b3a659e04e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:34.221077 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7771c1d9-f2b9-40a8-9296-d0b3a659e04e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:34.223061 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7771c1d9-f2b9-40a8-9296-d0b3a659e04e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:34.224503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7771c1d9-f2b9-40a8-9296-d0b3a659e04e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1654 microversion: 2.20 time: 0.096637 Sep 01 14:05:34.225066 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 348/671] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:34 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1654 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:35.296597 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:35.297079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:35.304627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:35.305110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:35.305551 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:35.306282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:35.306739 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:35.307162 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:35.353696 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:35.354205 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:35.354640 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:35.355193 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lazy-loading 'fault' on Instance uuid 0bac5a33-d73f-48a4-bead-fcf039becf3a {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:05:35.397258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:35.405791 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:35.407295 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:35.408431 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-480b8edc-8439-4831-8617-3ff53f54157b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 200 len: 1371 microversion: 2.20 time: 0.116474 Sep 01 14:05:35.408985 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 324/672] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:35 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:36.431980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-536550b1-3b74-4186-a4c3-161ddf36d5f2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:36.432610 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-536550b1-3b74-4186-a4c3-161ddf36d5f2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:36.439072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-536550b1-3b74-4186-a4c3-161ddf36d5f2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:36.439554 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-536550b1-3b74-4186-a4c3-161ddf36d5f2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:36.439986 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-536550b1-3b74-4186-a4c3-161ddf36d5f2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:36.440668 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-536550b1-3b74-4186-a4c3-161ddf36d5f2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:36.441120 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-536550b1-3b74-4186-a4c3-161ddf36d5f2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:36.444474 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-536550b1-3b74-4186-a4c3-161ddf36d5f2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:36.466689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-536550b1-3b74-4186-a4c3-161ddf36d5f2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] HTTP exception thrown: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-536550b1-3b74-4186-a4c3-161ddf36d5f2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Request method failure captured: Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a HTTP/1.1 Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsRog0CJcPYnwKv9f7xm92IKcNoh3D-IsG2eJ_g95XfMwbEzqe6qSgkUC49ZfLMbsozlxZr_m5SK4mQF02vH2pUSppg1b36GgCvg3sxnDTAol7C6owTWp71mXhbSMEs0yIFn0AoHHVgPfJ4CoxFI2ceHMBsZdCF53XnoWNesf4GIMQ Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 7e322f2f7da74039aff258b70af12095 Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:05:36.469059 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:05:36.470586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7e322f2f7da74039aff258b70af12095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7e322f2f7da74039aff258b70af12095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7e322f2f7da74039aff258b70af12095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7e322f2f7da74039aff258b70af12095"}]}] Sep 01 14:05:36.470586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:05:36.470586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 7e322f2f7da74039aff258b70af12095 Sep 01 14:05:36.470586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:05:36.470586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-AttachVolumeShelveTestJSON-1921641283-project Sep 01 14:05:36.470586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:05:36.470586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:05:36.470586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: b77f38582b8842d7a303e8431299191a Sep 01 14:05:36.470586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1921641283-project Sep 01 14:05:36.470586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:05:36.470586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:05:36.470586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '0bac5a33-d73f-48a4-bead-fcf039becf3a'} Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:05:36.471384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:05:36.472729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:05:36.474115 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-536550b1-3b74-4186-a4c3-161ddf36d5f2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Returning 404 to user: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:05:36.474115 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-536550b1-3b74-4186-a4c3-161ddf36d5f2 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 404 len: 111 microversion: 2.20 time: 0.043383 Sep 01 14:05:36.474115 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 349/673] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:36 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:05:36.480781 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-39955dfd-3bed-4563-af25-b94d79626cc0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '.version_select at 0x7f1afd226f70>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:36.614463 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-39955dfd-3bed-4563-af25-b94d79626cc0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1336841651" status: 204 len: 0 microversion: 2.20 time: 0.138035 Sep 01 14:05:36.615052 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 325/674] 10.222.0.61 () {60 vars in 1262 bytes} [Thu Sep 1 14:05:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1336841651 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 14:05:37.385236 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9ca35b23-b6aa-449a-996e-c7c5671922c0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Action: 'create', calling method: .version_select at 0x7f1b00c62b80>, body: {"keypair": {"name": "tempest-keypair-1066164268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMywk0K78NWahDkFSkPcoI3LLYVnvamt5mwm+gRp1n2FHbdXBBzJagh/rW5Y1WMv8iQX6LR54Mi3gi8aTMo0fyee0SLIRp3DJnTsKyN9JmlP81Tc9Lr8at6h+rWFizR6Mw=="}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:37.402897 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-9ca35b23-b6aa-449a-996e-c7c5671922c0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Getting quotas for project 7e322f2f7da74039aff258b70af12095. Resources: {'key_pairs'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:05:37.407113 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-9ca35b23-b6aa-449a-996e-c7c5671922c0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Getting quotas for user b77f38582b8842d7a303e8431299191a and project 7e322f2f7da74039aff258b70af12095. Resources: {'key_pairs'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:05:37.677387 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9ca35b23-b6aa-449a-996e-c7c5671922c0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.297137 Sep 01 14:05:37.678541 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 350/675] 10.222.0.61 () {62 vars in 1200 bytes} [Thu Sep 1 14:05:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 298 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 14:05:38.636279 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-353057261", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1757307735", "security_groups": [{"name": "tempest-secgroup-smoke-541905587"}], "block_device_mapping_v2": [{"uuid": "9239a501-96bc-4614-a8b1-60f46ec94415", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7c0e430-8712-4da5-b970-a9a556e70461"}]}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:38.756489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.network.neutron [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] validate_networks() for [('e7c0e430-8712-4da5-b970-a9a556e70461', None, None, None, None, None)] {{(pid=127812) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:05:39.213740 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Flavor limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:05:39.214184 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Image limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:05:39.214652 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Flavor pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:05:39.215085 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Image pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:05:39.215549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:05:39.226641 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:39.227360 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:39.227858 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:39.228657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:39.229340 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:39.229868 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:39.254149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Getting quotas for project 9086ba5c610d4954a238d6569ec32f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:05:39.259548 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Getting quotas for user 748b8b4771ac498a88fdd98c8a4914ad and project 9086ba5c610d4954a238d6569ec32f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:05:39.343261 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Going to run 1 instances... {{(pid=127812) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:05:39.347398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9239a501-96bc-4614-a8b1-60f46ec94415',volume_size=None,volume_type=None)] {{(pid=127812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:05:39.907391 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6d000b36-cc8e-4dbb-9ffc-8421b685182c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.275656 Sep 01 14:05:39.913926 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 326/676] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:05:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 14:05:39.919795 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-81de7236-7dc1-41d8-8252-ec33ba4fa9fd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:39.921182 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-81de7236-7dc1-41d8-8252-ec33ba4fa9fd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:39.979727 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e4069ca1-3db4-439c-961b-7b879bcdb244 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:39.982358 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e4069ca1-3db4-439c-961b-7b879bcdb244 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:39.989086 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e4069ca1-3db4-439c-961b-7b879bcdb244 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:39.990045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e4069ca1-3db4-439c-961b-7b879bcdb244 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:39.990688 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e4069ca1-3db4-439c-961b-7b879bcdb244 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:39.991591 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e4069ca1-3db4-439c-961b-7b879bcdb244 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:39.995051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e4069ca1-3db4-439c-961b-7b879bcdb244 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:39.995747 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e4069ca1-3db4-439c-961b-7b879bcdb244 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:40.004582 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-81de7236-7dc1-41d8-8252-ec33ba4fa9fd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:40.014862 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-81de7236-7dc1-41d8-8252-ec33ba4fa9fd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1094 microversion: 2.1 time: 0.099607 Sep 01 14:05:40.015616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 351/677] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:39 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:40.063652 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e4069ca1-3db4-439c-961b-7b879bcdb244 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087539 Sep 01 14:05:40.073071 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 327/678] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:05:39 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 14:05:40.179223 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-927c0568-a9a3-42c9-92cf-47701cf8b577 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:40.180050 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-927c0568-a9a3-42c9-92cf-47701cf8b577 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:40.187270 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-927c0568-a9a3-42c9-92cf-47701cf8b577 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:40.187941 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-927c0568-a9a3-42c9-92cf-47701cf8b577 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:40.188638 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-927c0568-a9a3-42c9-92cf-47701cf8b577 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:40.189458 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-927c0568-a9a3-42c9-92cf-47701cf8b577 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:40.190056 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-927c0568-a9a3-42c9-92cf-47701cf8b577 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:40.191016 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-927c0568-a9a3-42c9-92cf-47701cf8b577 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:40.224917 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-927c0568-a9a3-42c9-92cf-47701cf8b577 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Going to try to terminate instance {{(pid=127811) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:05:40.596097 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-927c0568-a9a3-42c9-92cf-47701cf8b577 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 204 len: 0 microversion: 2.1 time: 0.421630 Sep 01 14:05:40.597461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 352/679] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:05:40 2022] DELETE /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:05:40.611120 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4b6ee07a-2565-498f-b028-9cbbb8daf152 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:40.612489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4b6ee07a-2565-498f-b028-9cbbb8daf152 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:40.621754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b6ee07a-2565-498f-b028-9cbbb8daf152 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:40.622380 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b6ee07a-2565-498f-b028-9cbbb8daf152 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:40.623057 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b6ee07a-2565-498f-b028-9cbbb8daf152 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:40.623857 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b6ee07a-2565-498f-b028-9cbbb8daf152 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:40.624404 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b6ee07a-2565-498f-b028-9cbbb8daf152 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:40.624906 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4b6ee07a-2565-498f-b028-9cbbb8daf152 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:40.718295 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1250849774", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79bb2981-2b84-47d3-9624-36bfa610c42e"}], "security_groups": [{"name": "tempest-securitygroup--171442100"}], "key_name": "tempest-keypair-1066164268", "user_data": "}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:40.763150 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4b6ee07a-2565-498f-b028-9cbbb8daf152 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:40.771268 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4b6ee07a-2565-498f-b028-9cbbb8daf152 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1673 microversion: 2.1 time: 0.168146 Sep 01 14:05:40.771833 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 328/680] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:40 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:40.837216 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.network.neutron [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] validate_networks() for [('79bb2981-2b84-47d3-9624-36bfa610c42e', None, None, None, None, None)] {{(pid=127811) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:05:41.048283 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-57fda215-53a0-4ff2-ae6e-960428f0747d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:41.051170 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-57fda215-53a0-4ff2-ae6e-960428f0747d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:41.110775 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-57fda215-53a0-4ff2-ae6e-960428f0747d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:41.118091 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-57fda215-53a0-4ff2-ae6e-960428f0747d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1094 microversion: 2.1 time: 0.073237 Sep 01 14:05:41.119141 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 329/681] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:41 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:41.241828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Flavor limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:05:41.242347 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Image limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:05:41.242720 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Flavor pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:05:41.243783 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Image pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:05:41.244210 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:05:41.253391 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:41.255265 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:41.255265 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:41.255265 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:41.255682 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:41.256112 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:41.273011 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Getting quotas for project 7e322f2f7da74039aff258b70af12095. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:05:41.277960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Getting quotas for user b77f38582b8842d7a303e8431299191a and project 7e322f2f7da74039aff258b70af12095. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:05:41.289050 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Going to run 1 instances... {{(pid=127811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:05:41.292162 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:05:41.455361 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f63c1e11-5a8a-4096-96c9-d8713b52fb4b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.741939 Sep 01 14:05:41.456111 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 353/682] 10.222.0.61 () {62 vars in 1188 bytes} [Thu Sep 1 14:05:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 01 14:05:41.467468 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-63d1dad3-0939-489c-9f2b-7501dd2acd60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:41.468108 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-63d1dad3-0939-489c-9f2b-7501dd2acd60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:41.523294 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-63d1dad3-0939-489c-9f2b-7501dd2acd60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:41.532056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-63d1dad3-0939-489c-9f2b-7501dd2acd60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:41.533628 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-63d1dad3-0939-489c-9f2b-7501dd2acd60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:41.534757 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-63d1dad3-0939-489c-9f2b-7501dd2acd60 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1282 microversion: 2.20 time: 0.071171 Sep 01 14:05:41.535366 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 330/683] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:41 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:41.793816 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8b4d8a29-384e-4c1c-b09c-f6327edf5ca3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:41.794355 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8b4d8a29-384e-4c1c-b09c-f6327edf5ca3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:41.800893 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b4d8a29-384e-4c1c-b09c-f6327edf5ca3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:41.801416 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b4d8a29-384e-4c1c-b09c-f6327edf5ca3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:41.801897 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b4d8a29-384e-4c1c-b09c-f6327edf5ca3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:41.802612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b4d8a29-384e-4c1c-b09c-f6327edf5ca3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:41.803069 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b4d8a29-384e-4c1c-b09c-f6327edf5ca3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:41.803499 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b4d8a29-384e-4c1c-b09c-f6327edf5ca3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:41.944869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-8b4d8a29-384e-4c1c-b09c-f6327edf5ca3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:41.953415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8b4d8a29-384e-4c1c-b09c-f6327edf5ca3 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1673 microversion: 2.1 time: 0.164303 Sep 01 14:05:41.954305 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 354/684] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:41 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:42.139957 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ebe2fc7a-ccb4-4b82-958a-bd6e21ca1b7f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:42.140573 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ebe2fc7a-ccb4-4b82-958a-bd6e21ca1b7f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:42.147383 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ebe2fc7a-ccb4-4b82-958a-bd6e21ca1b7f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:42.151115 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ebe2fc7a-ccb4-4b82-958a-bd6e21ca1b7f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:42.151115 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ebe2fc7a-ccb4-4b82-958a-bd6e21ca1b7f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:42.151115 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ebe2fc7a-ccb4-4b82-958a-bd6e21ca1b7f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:42.151115 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ebe2fc7a-ccb4-4b82-958a-bd6e21ca1b7f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:42.151511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ebe2fc7a-ccb4-4b82-958a-bd6e21ca1b7f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:42.214298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ebe2fc7a-ccb4-4b82-958a-bd6e21ca1b7f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:42.222293 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ebe2fc7a-ccb4-4b82-958a-bd6e21ca1b7f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1144 microversion: 2.1 time: 0.086189 Sep 01 14:05:42.225899 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 331/685] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:42 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:42.558666 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-81b7d1f4-fad4-4031-a58e-27ade8b1a5cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:42.559235 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-81b7d1f4-fad4-4031-a58e-27ade8b1a5cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:42.565291 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-81b7d1f4-fad4-4031-a58e-27ade8b1a5cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:42.565800 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-81b7d1f4-fad4-4031-a58e-27ade8b1a5cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:42.566242 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-81b7d1f4-fad4-4031-a58e-27ade8b1a5cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:42.567015 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-81b7d1f4-fad4-4031-a58e-27ade8b1a5cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:42.567887 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-81b7d1f4-fad4-4031-a58e-27ade8b1a5cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:42.567887 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-81b7d1f4-fad4-4031-a58e-27ade8b1a5cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:42.634148 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-81b7d1f4-fad4-4031-a58e-27ade8b1a5cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:42.643078 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-81b7d1f4-fad4-4031-a58e-27ade8b1a5cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:42.644512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-81b7d1f4-fad4-4031-a58e-27ade8b1a5cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:42.645601 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-81b7d1f4-fad4-4031-a58e-27ade8b1a5cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1286 microversion: 2.20 time: 0.091093 Sep 01 14:05:42.646180 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 355/686] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:42 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:42.975635 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5984bb14-c836-4bb0-ae44-8dbc36cbb19c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:42.976295 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5984bb14-c836-4bb0-ae44-8dbc36cbb19c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:42.982422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5984bb14-c836-4bb0-ae44-8dbc36cbb19c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:42.982905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5984bb14-c836-4bb0-ae44-8dbc36cbb19c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:42.983339 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5984bb14-c836-4bb0-ae44-8dbc36cbb19c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:42.984028 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5984bb14-c836-4bb0-ae44-8dbc36cbb19c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:42.984483 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5984bb14-c836-4bb0-ae44-8dbc36cbb19c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:42.984902 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5984bb14-c836-4bb0-ae44-8dbc36cbb19c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:43.196884 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5984bb14-c836-4bb0-ae44-8dbc36cbb19c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:43.221036 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5984bb14-c836-4bb0-ae44-8dbc36cbb19c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1673 microversion: 2.1 time: 0.235888 Sep 01 14:05:43.221036 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 332/687] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:42 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1673 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:43.243938 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-68637891-9253-44a6-a8bc-e5ed0eb6e3bc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:43.244734 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-68637891-9253-44a6-a8bc-e5ed0eb6e3bc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:43.251700 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-68637891-9253-44a6-a8bc-e5ed0eb6e3bc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:43.252264 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-68637891-9253-44a6-a8bc-e5ed0eb6e3bc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:43.252779 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-68637891-9253-44a6-a8bc-e5ed0eb6e3bc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:43.253475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-68637891-9253-44a6-a8bc-e5ed0eb6e3bc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:43.253972 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-68637891-9253-44a6-a8bc-e5ed0eb6e3bc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:43.254398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-68637891-9253-44a6-a8bc-e5ed0eb6e3bc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:43.269826 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:43.336124 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-68637891-9253-44a6-a8bc-e5ed0eb6e3bc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:43.343932 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-68637891-9253-44a6-a8bc-e5ed0eb6e3bc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1136 microversion: 2.1 time: 0.104600 Sep 01 14:05:43.347902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 356/688] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:43 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1136 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:43.669340 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f124e5b4-a4bc-4330-81da-a5807eae33cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:43.670008 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f124e5b4-a4bc-4330-81da-a5807eae33cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:43.676689 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f124e5b4-a4bc-4330-81da-a5807eae33cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:43.677397 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f124e5b4-a4bc-4330-81da-a5807eae33cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:43.678026 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f124e5b4-a4bc-4330-81da-a5807eae33cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:43.678913 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f124e5b4-a4bc-4330-81da-a5807eae33cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:43.679719 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f124e5b4-a4bc-4330-81da-a5807eae33cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:43.680618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f124e5b4-a4bc-4330-81da-a5807eae33cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:43.757059 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f124e5b4-a4bc-4330-81da-a5807eae33cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:43.767003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f124e5b4-a4bc-4330-81da-a5807eae33cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:43.768456 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f124e5b4-a4bc-4330-81da-a5807eae33cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:43.769597 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f124e5b4-a4bc-4330-81da-a5807eae33cc tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1334 microversion: 2.20 time: 0.105627 Sep 01 14:05:43.770430 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 333/689] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:43 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1334 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:44.074966 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-f30fde69-a963-4bea-b338-076cccd62223 req-0a386319-6c8d-4572-87d7-e9028efb87a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95b52d39-e40f-40a7-8bde-3d47790fb1d2", "name": "network-vif-deleted", "tag": "08265fbd-a5f4-4e54-8590-79c40f94a17b"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:44.089821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f30fde69-a963-4bea-b338-076cccd62223 req-0a386319-6c8d-4572-87d7-e9028efb87a4 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:44.089821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f30fde69-a963-4bea-b338-076cccd62223 req-0a386319-6c8d-4572-87d7-e9028efb87a4 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:44.089821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f30fde69-a963-4bea-b338-076cccd62223 req-0a386319-6c8d-4572-87d7-e9028efb87a4 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:44.098304 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-f30fde69-a963-4bea-b338-076cccd62223 req-0a386319-6c8d-4572-87d7-e9028efb87a4 service nova] Creating event network-vif-deleted:08265fbd-a5f4-4e54-8590-79c40f94a17b for instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 on hv-cinder-85221 Sep 01 14:05:44.103816 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-f30fde69-a963-4bea-b338-076cccd62223 req-0a386319-6c8d-4572-87d7-e9028efb87a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033416 Sep 01 14:05:44.105244 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 357/690] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:44.230824 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d74b6086-12a9-44dc-b079-ad677e654735 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:44.232261 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d74b6086-12a9-44dc-b079-ad677e654735 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:44.240727 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d74b6086-12a9-44dc-b079-ad677e654735 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:44.241582 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d74b6086-12a9-44dc-b079-ad677e654735 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:44.242218 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d74b6086-12a9-44dc-b079-ad677e654735 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:44.243938 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d74b6086-12a9-44dc-b079-ad677e654735 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:44.244584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d74b6086-12a9-44dc-b079-ad677e654735 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:44.245175 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d74b6086-12a9-44dc-b079-ad677e654735 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:44.271953 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:44.324756 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d74b6086-12a9-44dc-b079-ad677e654735 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:44.332849 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d74b6086-12a9-44dc-b079-ad677e654735 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1322 microversion: 2.1 time: 0.106173 Sep 01 14:05:44.333488 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 334/691] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:44 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1322 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:44.369400 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b4ce210e-afc4-4d15-bacb-f8de2e9ecba5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:44.370392 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b4ce210e-afc4-4d15-bacb-f8de2e9ecba5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:44.377787 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b4ce210e-afc4-4d15-bacb-f8de2e9ecba5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:44.378334 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b4ce210e-afc4-4d15-bacb-f8de2e9ecba5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:44.378846 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b4ce210e-afc4-4d15-bacb-f8de2e9ecba5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:44.379612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b4ce210e-afc4-4d15-bacb-f8de2e9ecba5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:44.380272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b4ce210e-afc4-4d15-bacb-f8de2e9ecba5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:44.380788 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b4ce210e-afc4-4d15-bacb-f8de2e9ecba5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:44.458459 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-b4ce210e-afc4-4d15-bacb-f8de2e9ecba5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:44.468070 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b4ce210e-afc4-4d15-bacb-f8de2e9ecba5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1200 microversion: 2.1 time: 0.103901 Sep 01 14:05:44.468640 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 358/692] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:44 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1200 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:44.794192 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0ad2a09c-bc30-4a59-b475-fe2fcc28b818 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:44.794885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0ad2a09c-bc30-4a59-b475-fe2fcc28b818 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:44.803467 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0ad2a09c-bc30-4a59-b475-fe2fcc28b818 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:44.804341 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0ad2a09c-bc30-4a59-b475-fe2fcc28b818 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:44.805131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0ad2a09c-bc30-4a59-b475-fe2fcc28b818 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:44.811657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0ad2a09c-bc30-4a59-b475-fe2fcc28b818 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:44.812190 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0ad2a09c-bc30-4a59-b475-fe2fcc28b818 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:44.812650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0ad2a09c-bc30-4a59-b475-fe2fcc28b818 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:44.970049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0ad2a09c-bc30-4a59-b475-fe2fcc28b818 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:44.987479 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0ad2a09c-bc30-4a59-b475-fe2fcc28b818 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:44.995942 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0ad2a09c-bc30-4a59-b475-fe2fcc28b818 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:44.998761 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0ad2a09c-bc30-4a59-b475-fe2fcc28b818 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1342 microversion: 2.20 time: 0.208603 Sep 01 14:05:44.998761 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 335/693] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:44 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:45.370194 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:45.371559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:45.379787 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:45.381142 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:45.381686 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:45.382526 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:45.384266 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:45.384652 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:45.418734 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:45.419373 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:45.419821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:45.420270 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'fault' on Instance uuid 95b52d39-e40f-40a7-8bde-3d47790fb1d2 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:05:45.487321 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:45.497104 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-32e879d7-4440-40fb-a2c7-69519f397083 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:45.499442 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-32e879d7-4440-40fb-a2c7-69519f397083 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:45.511712 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32e879d7-4440-40fb-a2c7-69519f397083 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:45.512530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32e879d7-4440-40fb-a2c7-69519f397083 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:45.513286 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32e879d7-4440-40fb-a2c7-69519f397083 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:45.514581 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a1802e37-9784-4d73-8e7a-d58e02ecdb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 200 len: 1327 microversion: 2.1 time: 0.150104 Sep 01 14:05:45.514856 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32e879d7-4440-40fb-a2c7-69519f397083 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:45.515459 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32e879d7-4440-40fb-a2c7-69519f397083 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:45.516195 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32e879d7-4440-40fb-a2c7-69519f397083 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:45.516794 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 359/694] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:45 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 1327 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:45.696726 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-32e879d7-4440-40fb-a2c7-69519f397083 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:45.706622 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-32e879d7-4440-40fb-a2c7-69519f397083 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1210 microversion: 2.1 time: 0.220305 Sep 01 14:05:45.707497 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 336/695] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:45 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1210 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:46.020533 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1e689128-13fa-464c-a8a4-a3ff92c7ec08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:46.021158 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1e689128-13fa-464c-a8a4-a3ff92c7ec08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:46.027919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e689128-13fa-464c-a8a4-a3ff92c7ec08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:46.031981 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e689128-13fa-464c-a8a4-a3ff92c7ec08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:46.031981 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e689128-13fa-464c-a8a4-a3ff92c7ec08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:46.031981 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e689128-13fa-464c-a8a4-a3ff92c7ec08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:46.031981 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e689128-13fa-464c-a8a4-a3ff92c7ec08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:46.033087 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e689128-13fa-464c-a8a4-a3ff92c7ec08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:46.124805 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1e689128-13fa-464c-a8a4-a3ff92c7ec08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:46.134616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1e689128-13fa-464c-a8a4-a3ff92c7ec08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:46.136286 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1e689128-13fa-464c-a8a4-a3ff92c7ec08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:46.137559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1e689128-13fa-464c-a8a4-a3ff92c7ec08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1340 microversion: 2.20 time: 0.120991 Sep 01 14:05:46.138816 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 360/696] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:46 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1340 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:46.716540 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a3acb870-d52c-49eb-8fd6-fcfcae577098 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:46.721623 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a3acb870-d52c-49eb-8fd6-fcfcae577098 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:46.723809 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a3acb870-d52c-49eb-8fd6-fcfcae577098 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:46.724664 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a3acb870-d52c-49eb-8fd6-fcfcae577098 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:46.725118 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a3acb870-d52c-49eb-8fd6-fcfcae577098 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:46.725876 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a3acb870-d52c-49eb-8fd6-fcfcae577098 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:46.726336 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a3acb870-d52c-49eb-8fd6-fcfcae577098 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:46.726764 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a3acb870-d52c-49eb-8fd6-fcfcae577098 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:46.730500 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-65c3a96a-d1da-438a-9dc6-0b6f05fb9704 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:46.731306 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-65c3a96a-d1da-438a-9dc6-0b6f05fb9704 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:46.738446 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-65c3a96a-d1da-438a-9dc6-0b6f05fb9704 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:46.738999 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-65c3a96a-d1da-438a-9dc6-0b6f05fb9704 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:46.739442 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-65c3a96a-d1da-438a-9dc6-0b6f05fb9704 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:46.740158 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-65c3a96a-d1da-438a-9dc6-0b6f05fb9704 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:46.740804 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-65c3a96a-d1da-438a-9dc6-0b6f05fb9704 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:46.741491 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-65c3a96a-d1da-438a-9dc6-0b6f05fb9704 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:46.744627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-a3acb870-d52c-49eb-8fd6-fcfcae577098 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] HTTP exception thrown: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a3acb870-d52c-49eb-8fd6-fcfcae577098 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Request method failure captured: Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 HTTP/1.1 Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsNoDTHn4-FKCM-pw08haUU-18wBooHgKYDMZ9YT7YD_3cF7BnnsRI00kcocU6uEn6J_TPzKwIQMuiRAjJyt0Gw1eMAbBj8EfX1TPGQOLVDEfaFSRLk8-k8JoGE04xzyk--FLOLi2mGlQRnequ-h-k77WoQbj4sSFOHwt4Huzc6W7g Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 8352a8d484e24264a536b8960dab338f Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:05:46.746438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:05:46.747861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8352a8d484e24264a536b8960dab338f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8352a8d484e24264a536b8960dab338f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8352a8d484e24264a536b8960dab338f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8352a8d484e24264a536b8960dab338f"}]}] Sep 01 14:05:46.747861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:05:46.747861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 8352a8d484e24264a536b8960dab338f Sep 01 14:05:46.747861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:05:46.747861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-AttachVolumeTestJSON-547809350-project Sep 01 14:05:46.747861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:05:46.747861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:05:46.747861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 1943057b69d342d9b45fc02be9f3d5aa Sep 01 14:05:46.747861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-AttachVolumeTestJSON-547809350-project Sep 01 14:05:46.747861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:05:46.747861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:05:46.747861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '95b52d39-e40f-40a7-8bde-3d47790fb1d2'} Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:05:46.748650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:05:46.749967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:05:46.751387 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a3acb870-d52c-49eb-8fd6-fcfcae577098 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Returning 404 to user: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:05:46.751387 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a3acb870-d52c-49eb-8fd6-fcfcae577098 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 404 len: 111 microversion: 2.1 time: 0.185320 Sep 01 14:05:46.751387 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 337/697] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:46 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:05:46.758156 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f379a7bb-436e-4b98-97fd-f57338890e27 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '.version_select at 0x7f1afd462790>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:46.860404 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f379a7bb-436e-4b98-97fd-f57338890e27 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505611958" status: 202 len: 0 microversion: 2.1 time: 0.106389 Sep 01 14:05:46.866440 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 338/698] 10.222.0.61 () {58 vars in 1221 bytes} [Thu Sep 1 14:05:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1505611958 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:05:47.038945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-65c3a96a-d1da-438a-9dc6-0b6f05fb9704 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:47.048803 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-65c3a96a-d1da-438a-9dc6-0b6f05fb9704 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1277 microversion: 2.1 time: 0.322839 Sep 01 14:05:47.049434 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 361/699] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:46 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1277 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:47.163442 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-90b68a96-111b-40bb-bb99-268eb78dab89 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:47.164105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-90b68a96-111b-40bb-bb99-268eb78dab89 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:47.172373 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90b68a96-111b-40bb-bb99-268eb78dab89 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:47.175101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90b68a96-111b-40bb-bb99-268eb78dab89 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:47.175101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90b68a96-111b-40bb-bb99-268eb78dab89 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:47.175101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90b68a96-111b-40bb-bb99-268eb78dab89 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:47.175101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90b68a96-111b-40bb-bb99-268eb78dab89 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:47.175648 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90b68a96-111b-40bb-bb99-268eb78dab89 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:47.684499 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-90b68a96-111b-40bb-bb99-268eb78dab89 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:47.693559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-90b68a96-111b-40bb-bb99-268eb78dab89 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:47.695079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-90b68a96-111b-40bb-bb99-268eb78dab89 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:47.696905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-90b68a96-111b-40bb-bb99-268eb78dab89 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1407 microversion: 2.20 time: 0.537936 Sep 01 14:05:47.697485 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 339/700] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:47 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1407 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:48.071970 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4380ea9f-13d7-4f89-aaf2-f3a69d4835a8 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:48.072588 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4380ea9f-13d7-4f89-aaf2-f3a69d4835a8 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:48.079815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4380ea9f-13d7-4f89-aaf2-f3a69d4835a8 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:48.080312 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4380ea9f-13d7-4f89-aaf2-f3a69d4835a8 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:48.080752 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4380ea9f-13d7-4f89-aaf2-f3a69d4835a8 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:48.081479 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4380ea9f-13d7-4f89-aaf2-f3a69d4835a8 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:48.081980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4380ea9f-13d7-4f89-aaf2-f3a69d4835a8 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:48.082405 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4380ea9f-13d7-4f89-aaf2-f3a69d4835a8 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:48.217381 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-ac268cf1-c9b7-425e-8e07-a3c8ebb6f955 req-bf6d1d63-8ad0-460a-932f-ee226d5f0950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ec24f5b-aec6-406b-bf20-dd2e3d4e8438", "tag": "b21bbade-8af9-44b2-960e-25704dbd478c"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:48.229017 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ac268cf1-c9b7-425e-8e07-a3c8ebb6f955 req-bf6d1d63-8ad0-460a-932f-ee226d5f0950 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:48.229597 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ac268cf1-c9b7-425e-8e07-a3c8ebb6f955 req-bf6d1d63-8ad0-460a-932f-ee226d5f0950 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:48.230119 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ac268cf1-c9b7-425e-8e07-a3c8ebb6f955 req-bf6d1d63-8ad0-460a-932f-ee226d5f0950 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:48.243424 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-ac268cf1-c9b7-425e-8e07-a3c8ebb6f955 req-bf6d1d63-8ad0-460a-932f-ee226d5f0950 service nova] Creating event network-changed:b21bbade-8af9-44b2-960e-25704dbd478c for instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 on hv-cinder-85221 Sep 01 14:05:48.249080 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-ac268cf1-c9b7-425e-8e07-a3c8ebb6f955 req-bf6d1d63-8ad0-460a-932f-ee226d5f0950 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037296 Sep 01 14:05:48.255608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 340/701] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:05:48.457229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4380ea9f-13d7-4f89-aaf2-f3a69d4835a8 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:48.468491 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4380ea9f-13d7-4f89-aaf2-f3a69d4835a8 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.401036 Sep 01 14:05:48.469264 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 362/702] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:48 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:48.550500 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3e257429-c8fe-4819-afec-95d44aedf48a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Action: 'create', calling method: .version_select at 0x7f1afd2150d0>, body: {"keypair": {"name": "tempest-keypair-188355312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/qcReD/fQCcgE/h8t/fMlZnBgkxpySl822wJilyC6Cpg1/nDe3MvOlCmRQyzWhwjIN4JOf9sbIa0H521DhIDjwIOs5k9hcbCJqBfrnggOfu6qkJ5SLuV7o2jn60/NMCw=="}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:48.573820 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-3e257429-c8fe-4819-afec-95d44aedf48a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Getting quotas for project 8352a8d484e24264a536b8960dab338f. Resources: {'key_pairs'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:05:48.579488 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-3e257429-c8fe-4819-afec-95d44aedf48a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Getting quotas for user 1943057b69d342d9b45fc02be9f3d5aa and project 8352a8d484e24264a536b8960dab338f. Resources: {'key_pairs'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:05:48.677323 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3e257429-c8fe-4819-afec-95d44aedf48a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.131434 Sep 01 14:05:48.678147 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 341/703] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 1 14:05:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:48.720006 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9a32cec0-63f5-47b4-818d-7f8703af811b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:48.720627 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9a32cec0-63f5-47b4-818d-7f8703af811b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:48.727236 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a32cec0-63f5-47b4-818d-7f8703af811b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:48.727744 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a32cec0-63f5-47b4-818d-7f8703af811b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:48.728193 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a32cec0-63f5-47b4-818d-7f8703af811b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:48.728908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a32cec0-63f5-47b4-818d-7f8703af811b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:48.729366 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a32cec0-63f5-47b4-818d-7f8703af811b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:48.729875 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a32cec0-63f5-47b4-818d-7f8703af811b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:48.980123 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9a32cec0-63f5-47b4-818d-7f8703af811b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:48.990333 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9a32cec0-63f5-47b4-818d-7f8703af811b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:48.992748 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9a32cec0-63f5-47b4-818d-7f8703af811b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:48.996957 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9a32cec0-63f5-47b4-818d-7f8703af811b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1407 microversion: 2.20 time: 0.278961 Sep 01 14:05:48.996957 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 363/704] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:48 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:49.594299 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9aefe2b0-5da6-4590-bd57-76c86efffc2b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:49.596051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9aefe2b0-5da6-4590-bd57-76c86efffc2b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:49.603317 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:49.606387 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9aefe2b0-5da6-4590-bd57-76c86efffc2b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:49.607464 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9aefe2b0-5da6-4590-bd57-76c86efffc2b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:49.608196 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9aefe2b0-5da6-4590-bd57-76c86efffc2b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:49.609173 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9aefe2b0-5da6-4590-bd57-76c86efffc2b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:49.609948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9aefe2b0-5da6-4590-bd57-76c86efffc2b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:49.610576 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9aefe2b0-5da6-4590-bd57-76c86efffc2b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:50.016241 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9aefe2b0-5da6-4590-bd57-76c86efffc2b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:50.025177 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9aefe2b0-5da6-4590-bd57-76c86efffc2b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.435818 Sep 01 14:05:50.025979 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 342/705] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:49 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:50.081050 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-529ca847-cbcb-45ed-b81a-1d03cbbedb3f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:50.081738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-529ca847-cbcb-45ed-b81a-1d03cbbedb3f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:50.095004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-529ca847-cbcb-45ed-b81a-1d03cbbedb3f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:50.095593 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-529ca847-cbcb-45ed-b81a-1d03cbbedb3f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:50.096107 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-529ca847-cbcb-45ed-b81a-1d03cbbedb3f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:50.096945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-529ca847-cbcb-45ed-b81a-1d03cbbedb3f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:50.097461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-529ca847-cbcb-45ed-b81a-1d03cbbedb3f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:50.098016 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-529ca847-cbcb-45ed-b81a-1d03cbbedb3f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:50.235677 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-529ca847-cbcb-45ed-b81a-1d03cbbedb3f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:50.245497 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-529ca847-cbcb-45ed-b81a-1d03cbbedb3f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:50.247048 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-529ca847-cbcb-45ed-b81a-1d03cbbedb3f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:50.248180 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-529ca847-cbcb-45ed-b81a-1d03cbbedb3f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1407 microversion: 2.20 time: 0.234233 Sep 01 14:05:50.248741 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 364/706] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:50 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:05:50.269450 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-0beb9ee1-c91f-4024-b052-3904a945af3d req-f340d072-2d0f-4790-a4f4-fc262d7e0fec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aacf49fd-7b35-4e19-81f0-098fc9d2b0d6", "tag": "fce10985-ae68-4e7b-beef-fef3f597b453"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:50.279920 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0beb9ee1-c91f-4024-b052-3904a945af3d req-f340d072-2d0f-4790-a4f4-fc262d7e0fec service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:50.280632 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0beb9ee1-c91f-4024-b052-3904a945af3d req-f340d072-2d0f-4790-a4f4-fc262d7e0fec service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:50.281251 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0beb9ee1-c91f-4024-b052-3904a945af3d req-f340d072-2d0f-4790-a4f4-fc262d7e0fec service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:50.292843 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-0beb9ee1-c91f-4024-b052-3904a945af3d req-f340d072-2d0f-4790-a4f4-fc262d7e0fec service nova] Creating event network-changed:fce10985-ae68-4e7b-beef-fef3f597b453 for instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 on hv-cinder-85221 Sep 01 14:05:50.297763 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-0beb9ee1-c91f-4024-b052-3904a945af3d req-f340d072-2d0f-4790-a4f4-fc262d7e0fec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032340 Sep 01 14:05:50.298369 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 343/707] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:51.046967 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-825914ee-43e7-4300-a48d-32b571451d90 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:51.047583 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-825914ee-43e7-4300-a48d-32b571451d90 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:51.054381 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-825914ee-43e7-4300-a48d-32b571451d90 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:51.054880 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-825914ee-43e7-4300-a48d-32b571451d90 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:51.055895 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-825914ee-43e7-4300-a48d-32b571451d90 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:51.056636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-825914ee-43e7-4300-a48d-32b571451d90 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:51.057094 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-825914ee-43e7-4300-a48d-32b571451d90 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:51.057523 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-825914ee-43e7-4300-a48d-32b571451d90 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:51.171478 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2140795460", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5403c91e-c3bf-4c71-9cf1-2c320c1a9401"}], "security_groups": [{"name": "tempest-securitygroup--120430767"}], "key_name": "tempest-keypair-188355312", "user_data": "}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:51.201495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-825914ee-43e7-4300-a48d-32b571451d90 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:51.210118 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-825914ee-43e7-4300-a48d-32b571451d90 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.167131 Sep 01 14:05:51.210704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 365/708] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:51 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:51.272516 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-eba7fa91-98fd-4542-ab07-9bdb6779b47e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:51.273145 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-eba7fa91-98fd-4542-ab07-9bdb6779b47e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:51.277663 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:51.285917 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=12 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:51.289309 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-eba7fa91-98fd-4542-ab07-9bdb6779b47e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:51.290710 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-eba7fa91-98fd-4542-ab07-9bdb6779b47e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:51.291630 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-eba7fa91-98fd-4542-ab07-9bdb6779b47e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:51.292942 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-eba7fa91-98fd-4542-ab07-9bdb6779b47e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:51.293790 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-eba7fa91-98fd-4542-ab07-9bdb6779b47e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:51.294606 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-eba7fa91-98fd-4542-ab07-9bdb6779b47e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:51.318008 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.network.neutron [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] validate_networks() for [('5403c91e-c3bf-4c71-9cf1-2c320c1a9401', None, None, None, None, None)] {{(pid=127812) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:05:51.560129 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-eba7fa91-98fd-4542-ab07-9bdb6779b47e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:51.569103 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-eba7fa91-98fd-4542-ab07-9bdb6779b47e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:51.570735 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-eba7fa91-98fd-4542-ab07-9bdb6779b47e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:51.572214 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-eba7fa91-98fd-4542-ab07-9bdb6779b47e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1407 microversion: 2.20 time: 0.303357 Sep 01 14:05:51.585804 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 366/709] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:51 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:05:52.104290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Flavor limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:05:52.104713 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Image limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:05:52.105405 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Flavor pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:05:52.105897 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Image pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:05:52.106313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:05:52.122126 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:52.122991 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:52.124140 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:52.124140 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:52.124520 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:52.124947 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:52.154744 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Getting quotas for project 8352a8d484e24264a536b8960dab338f. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:05:52.159168 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Getting quotas for user 1943057b69d342d9b45fc02be9f3d5aa and project 8352a8d484e24264a536b8960dab338f. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:05:52.172221 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Going to run 1 instances... {{(pid=127812) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:05:52.174690 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:05:52.233425 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c16d268d-473e-40c6-9c88-c32f0c1379b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:52.238126 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c16d268d-473e-40c6-9c88-c32f0c1379b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:52.241003 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c16d268d-473e-40c6-9c88-c32f0c1379b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:52.241647 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c16d268d-473e-40c6-9c88-c32f0c1379b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:52.242175 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c16d268d-473e-40c6-9c88-c32f0c1379b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:52.243212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c16d268d-473e-40c6-9c88-c32f0c1379b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:52.243739 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c16d268d-473e-40c6-9c88-c32f0c1379b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:52.244265 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c16d268d-473e-40c6-9c88-c32f0c1379b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:52.385447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c16d268d-473e-40c6-9c88-c32f0c1379b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:52.393898 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c16d268d-473e-40c6-9c88-c32f0c1379b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.164515 Sep 01 14:05:52.394606 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 367/710] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:52 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:52.406541 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f211ad50-4076-434c-99fc-de1f27d5fa0c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "402293c6-238b-4b8c-86ac-ac2402ded0c6"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:52.406541 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f211ad50-4076-434c-99fc-de1f27d5fa0c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:52.410111 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f211ad50-4076-434c-99fc-de1f27d5fa0c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:52.410798 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f211ad50-4076-434c-99fc-de1f27d5fa0c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:52.411395 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f211ad50-4076-434c-99fc-de1f27d5fa0c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:52.412268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f211ad50-4076-434c-99fc-de1f27d5fa0c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:52.412874 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f211ad50-4076-434c-99fc-de1f27d5fa0c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:52.413454 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f211ad50-4076-434c-99fc-de1f27d5fa0c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:52.424289 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ce33e20b-f573-4cb6-8e6d-817f9c0be957 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.258378 Sep 01 14:05:52.424972 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 344/711] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:05:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:05:52.444658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ab2f8f40-aba0-43d1-bdf8-8112504dfc81 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:52.445290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ab2f8f40-aba0-43d1-bdf8-8112504dfc81 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:52.507392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ab2f8f40-aba0-43d1-bdf8-8112504dfc81 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:52.516058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ab2f8f40-aba0-43d1-bdf8-8112504dfc81 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1237 microversion: 2.1 time: 0.083220 Sep 01 14:05:52.517003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 345/712] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:52 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:52.594633 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-52094275-3575-422e-8843-aeb73806f92a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:52.595696 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-52094275-3575-422e-8843-aeb73806f92a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:52.603007 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:52.613458 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-52094275-3575-422e-8843-aeb73806f92a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:52.615276 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-52094275-3575-422e-8843-aeb73806f92a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:52.615276 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-52094275-3575-422e-8843-aeb73806f92a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:52.616528 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-52094275-3575-422e-8843-aeb73806f92a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:52.616528 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-52094275-3575-422e-8843-aeb73806f92a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:52.616988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-52094275-3575-422e-8843-aeb73806f92a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:52.779283 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-52094275-3575-422e-8843-aeb73806f92a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:52.788893 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-52094275-3575-422e-8843-aeb73806f92a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:52.790545 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-52094275-3575-422e-8843-aeb73806f92a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:52.791696 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-52094275-3575-422e-8843-aeb73806f92a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1407 microversion: 2.20 time: 0.201031 Sep 01 14:05:52.795643 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 346/713] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:52 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:05:53.420537 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-572cd816-5877-4117-9d9e-f897c54497f5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:53.421538 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-572cd816-5877-4117-9d9e-f897c54497f5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:53.434885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-572cd816-5877-4117-9d9e-f897c54497f5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:53.434885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-572cd816-5877-4117-9d9e-f897c54497f5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:53.434885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-572cd816-5877-4117-9d9e-f897c54497f5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:53.434885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-572cd816-5877-4117-9d9e-f897c54497f5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:53.435498 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-572cd816-5877-4117-9d9e-f897c54497f5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:53.435498 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-572cd816-5877-4117-9d9e-f897c54497f5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:53.508629 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f211ad50-4076-434c-99fc-de1f27d5fa0c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "POST /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.112571 Sep 01 14:05:53.510081 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 368/714] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:05:52 2022] POST /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-volume_attachments => generated 194 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:53.541058 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-67294481-7142-47ed-ac48-73aa5ecbe99e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:53.542390 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-67294481-7142-47ed-ac48-73aa5ecbe99e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:53.622863 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-67294481-7142-47ed-ac48-73aa5ecbe99e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:53.630893 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-67294481-7142-47ed-ac48-73aa5ecbe99e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1237 microversion: 2.1 time: 0.094760 Sep 01 14:05:53.632960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 369/715] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:53 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:53.634593 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-572cd816-5877-4117-9d9e-f897c54497f5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:53.642720 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-572cd816-5877-4117-9d9e-f897c54497f5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.226030 Sep 01 14:05:53.643296 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 347/716] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:53 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:53.815020 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-bae0ba0b-9c2a-4fde-b1c8-8f5dc983451a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:53.815703 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-bae0ba0b-9c2a-4fde-b1c8-8f5dc983451a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:53.818323 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:53.824736 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bae0ba0b-9c2a-4fde-b1c8-8f5dc983451a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:53.825230 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bae0ba0b-9c2a-4fde-b1c8-8f5dc983451a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:53.825672 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bae0ba0b-9c2a-4fde-b1c8-8f5dc983451a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:53.826488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bae0ba0b-9c2a-4fde-b1c8-8f5dc983451a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:53.826944 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bae0ba0b-9c2a-4fde-b1c8-8f5dc983451a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:53.827475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bae0ba0b-9c2a-4fde-b1c8-8f5dc983451a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:53.970459 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-bae0ba0b-9c2a-4fde-b1c8-8f5dc983451a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:53.979886 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-bae0ba0b-9c2a-4fde-b1c8-8f5dc983451a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:53.981321 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-bae0ba0b-9c2a-4fde-b1c8-8f5dc983451a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:53.982805 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-bae0ba0b-9c2a-4fde-b1c8-8f5dc983451a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1407 microversion: 2.20 time: 0.171789 Sep 01 14:05:53.983371 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 370/717] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:53 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:54.657878 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6a4d514e-f248-4816-b43e-94169412fb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:54.658902 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-6a4d514e-f248-4816-b43e-94169412fb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:54.666693 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cde640bb-af9a-4462-be49-31d650f5fa4b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:54.667206 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6a4d514e-f248-4816-b43e-94169412fb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:54.667781 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-cde640bb-af9a-4462-be49-31d650f5fa4b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:54.668279 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6a4d514e-f248-4816-b43e-94169412fb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:54.668487 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6a4d514e-f248-4816-b43e-94169412fb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:54.669451 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6a4d514e-f248-4816-b43e-94169412fb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:54.670411 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6a4d514e-f248-4816-b43e-94169412fb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:54.671049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6a4d514e-f248-4816-b43e-94169412fb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:54.688285 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cde640bb-af9a-4462-be49-31d650f5fa4b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:54.688881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cde640bb-af9a-4462-be49-31d650f5fa4b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:54.692253 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cde640bb-af9a-4462-be49-31d650f5fa4b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:54.697563 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cde640bb-af9a-4462-be49-31d650f5fa4b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:54.698714 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cde640bb-af9a-4462-be49-31d650f5fa4b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:54.700785 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cde640bb-af9a-4462-be49-31d650f5fa4b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:54.772792 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-6a4d514e-f248-4816-b43e-94169412fb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:54.784292 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6a4d514e-f248-4816-b43e-94169412fb84 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1289 microversion: 2.1 time: 0.130852 Sep 01 14:05:54.785271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 348/718] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:54 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1289 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:54.842260 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-bcca97d7-403d-40b2-8367-b83b2d0864e7 req-847a4721-1428-47c2-9cd6-4e8b0cb7bd0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacf49fd-7b35-4e19-81f0-098fc9d2b0d6", "name": "network-vif-plugged", "status": "completed", "tag": "fce10985-ae68-4e7b-beef-fef3f597b453"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:54.852746 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-bcca97d7-403d-40b2-8367-b83b2d0864e7 req-847a4721-1428-47c2-9cd6-4e8b0cb7bd0a service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:54.854457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-bcca97d7-403d-40b2-8367-b83b2d0864e7 req-847a4721-1428-47c2-9cd6-4e8b0cb7bd0a service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:54.854457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-bcca97d7-403d-40b2-8367-b83b2d0864e7 req-847a4721-1428-47c2-9cd6-4e8b0cb7bd0a service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:54.867365 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-bcca97d7-403d-40b2-8367-b83b2d0864e7 req-847a4721-1428-47c2-9cd6-4e8b0cb7bd0a service nova] Creating event network-vif-plugged:fce10985-ae68-4e7b-beef-fef3f597b453 for instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 on hv-cinder-85221 Sep 01 14:05:54.873162 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-bcca97d7-403d-40b2-8367-b83b2d0864e7 req-847a4721-1428-47c2-9cd6-4e8b0cb7bd0a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036289 Sep 01 14:05:54.873897 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 349/719] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:05:54.878064 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cde640bb-af9a-4462-be49-31d650f5fa4b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:54.887210 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cde640bb-af9a-4462-be49-31d650f5fa4b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.226842 Sep 01 14:05:54.887790 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 371/720] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:54 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:55.005739 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f21056a5-20b7-4220-aa8c-6d8bd6d0319e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:55.006377 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f21056a5-20b7-4220-aa8c-6d8bd6d0319e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:55.013752 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f21056a5-20b7-4220-aa8c-6d8bd6d0319e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:55.014379 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f21056a5-20b7-4220-aa8c-6d8bd6d0319e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:55.014829 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f21056a5-20b7-4220-aa8c-6d8bd6d0319e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:55.015580 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f21056a5-20b7-4220-aa8c-6d8bd6d0319e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:55.016038 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f21056a5-20b7-4220-aa8c-6d8bd6d0319e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:55.016469 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f21056a5-20b7-4220-aa8c-6d8bd6d0319e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:55.163172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f21056a5-20b7-4220-aa8c-6d8bd6d0319e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:55.171615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f21056a5-20b7-4220-aa8c-6d8bd6d0319e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:55.173045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f21056a5-20b7-4220-aa8c-6d8bd6d0319e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:55.174171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f21056a5-20b7-4220-aa8c-6d8bd6d0319e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1407 microversion: 2.20 time: 0.172915 Sep 01 14:05:55.174732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 350/721] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:54 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:55.807994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-68bc35d9-8f13-4400-a90a-66f6b177c3a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:55.808638 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-68bc35d9-8f13-4400-a90a-66f6b177c3a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:55.815174 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-68bc35d9-8f13-4400-a90a-66f6b177c3a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:55.815704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-68bc35d9-8f13-4400-a90a-66f6b177c3a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:55.816168 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-68bc35d9-8f13-4400-a90a-66f6b177c3a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:55.816877 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-68bc35d9-8f13-4400-a90a-66f6b177c3a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:55.817389 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-68bc35d9-8f13-4400-a90a-66f6b177c3a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:55.817761 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-68bc35d9-8f13-4400-a90a-66f6b177c3a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:55.883764 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-68bc35d9-8f13-4400-a90a-66f6b177c3a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:55.891702 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-68bc35d9-8f13-4400-a90a-66f6b177c3a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1307 microversion: 2.1 time: 0.088258 Sep 01 14:05:55.892282 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 372/722] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:55 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:55.908981 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e5bd656e-664e-4dc7-946d-4ca3a563388b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:55.909582 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e5bd656e-664e-4dc7-946d-4ca3a563388b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:55.916847 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5bd656e-664e-4dc7-946d-4ca3a563388b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:55.918606 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5bd656e-664e-4dc7-946d-4ca3a563388b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:55.918606 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5bd656e-664e-4dc7-946d-4ca3a563388b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:55.918814 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5bd656e-664e-4dc7-946d-4ca3a563388b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:55.919088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5bd656e-664e-4dc7-946d-4ca3a563388b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:55.919512 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e5bd656e-664e-4dc7-946d-4ca3a563388b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:56.113136 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e5bd656e-664e-4dc7-946d-4ca3a563388b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:56.122148 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e5bd656e-664e-4dc7-946d-4ca3a563388b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.217131 Sep 01 14:05:56.123089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 351/723] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:55 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:56.196533 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-84900620-329d-4c81-b360-1d7ed1fc4b79 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:56.197126 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-84900620-329d-4c81-b360-1d7ed1fc4b79 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:56.203120 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-84900620-329d-4c81-b360-1d7ed1fc4b79 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:56.203601 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-84900620-329d-4c81-b360-1d7ed1fc4b79 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:56.204036 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-84900620-329d-4c81-b360-1d7ed1fc4b79 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:56.204727 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-84900620-329d-4c81-b360-1d7ed1fc4b79 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:56.205204 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-84900620-329d-4c81-b360-1d7ed1fc4b79 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:56.205714 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-84900620-329d-4c81-b360-1d7ed1fc4b79 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:56.208315 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:05:56.438753 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-84900620-329d-4c81-b360-1d7ed1fc4b79 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:56.447610 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-84900620-329d-4c81-b360-1d7ed1fc4b79 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:56.449071 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-84900620-329d-4c81-b360-1d7ed1fc4b79 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:56.450676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-84900620-329d-4c81-b360-1d7ed1fc4b79 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1407 microversion: 2.20 time: 0.257910 Sep 01 14:05:56.451251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 373/724] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:56 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:56.912794 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-75bb86bd-b98d-4cd8-9388-2a1ea563b50d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:56.913442 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-75bb86bd-b98d-4cd8-9388-2a1ea563b50d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:56.920326 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-75bb86bd-b98d-4cd8-9388-2a1ea563b50d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:56.920813 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-75bb86bd-b98d-4cd8-9388-2a1ea563b50d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:56.921313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-75bb86bd-b98d-4cd8-9388-2a1ea563b50d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:56.922049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-75bb86bd-b98d-4cd8-9388-2a1ea563b50d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:56.922503 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-75bb86bd-b98d-4cd8-9388-2a1ea563b50d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:56.922928 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-75bb86bd-b98d-4cd8-9388-2a1ea563b50d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:57.065284 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-75bb86bd-b98d-4cd8-9388-2a1ea563b50d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:57.073270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-75bb86bd-b98d-4cd8-9388-2a1ea563b50d tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1362 microversion: 2.1 time: 0.164407 Sep 01 14:05:57.073868 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 352/725] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:56 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:05:57.144436 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-37804b04-52d6-486a-b09c-b1601def2696 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:57.145050 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-37804b04-52d6-486a-b09c-b1601def2696 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:57.151674 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37804b04-52d6-486a-b09c-b1601def2696 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:57.152218 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37804b04-52d6-486a-b09c-b1601def2696 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:57.152661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37804b04-52d6-486a-b09c-b1601def2696 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:57.153409 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37804b04-52d6-486a-b09c-b1601def2696 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:57.153897 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37804b04-52d6-486a-b09c-b1601def2696 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:57.154335 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-37804b04-52d6-486a-b09c-b1601def2696 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:57.293177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-37804b04-52d6-486a-b09c-b1601def2696 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:57.300973 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-37804b04-52d6-486a-b09c-b1601def2696 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.160699 Sep 01 14:05:57.301552 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 374/726] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:57 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:57.487129 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-57f49352-8d6c-4b9a-9515-abfd4534f876 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:57.487732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-57f49352-8d6c-4b9a-9515-abfd4534f876 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:57.494374 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57f49352-8d6c-4b9a-9515-abfd4534f876 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:57.494860 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57f49352-8d6c-4b9a-9515-abfd4534f876 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:57.495292 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57f49352-8d6c-4b9a-9515-abfd4534f876 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:57.496034 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57f49352-8d6c-4b9a-9515-abfd4534f876 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:57.496486 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57f49352-8d6c-4b9a-9515-abfd4534f876 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:57.496908 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57f49352-8d6c-4b9a-9515-abfd4534f876 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:57.639115 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-57f49352-8d6c-4b9a-9515-abfd4534f876 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:57.648073 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-57f49352-8d6c-4b9a-9515-abfd4534f876 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:57.650091 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-57f49352-8d6c-4b9a-9515-abfd4534f876 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:57.651219 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-57f49352-8d6c-4b9a-9515-abfd4534f876 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1407 microversion: 2.20 time: 0.168342 Sep 01 14:05:57.651798 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 353/727] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:57 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:58.095434 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f0f1ab7c-17c5-4a46-a41f-f8ea8938d5e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:58.096180 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f0f1ab7c-17c5-4a46-a41f-f8ea8938d5e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:58.104377 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f0f1ab7c-17c5-4a46-a41f-f8ea8938d5e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:58.104377 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f0f1ab7c-17c5-4a46-a41f-f8ea8938d5e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:58.104751 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f0f1ab7c-17c5-4a46-a41f-f8ea8938d5e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:58.105544 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f0f1ab7c-17c5-4a46-a41f-f8ea8938d5e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:58.106024 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f0f1ab7c-17c5-4a46-a41f-f8ea8938d5e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:58.106487 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f0f1ab7c-17c5-4a46-a41f-f8ea8938d5e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:58.292940 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f0f1ab7c-17c5-4a46-a41f-f8ea8938d5e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:58.309317 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f0f1ab7c-17c5-4a46-a41f-f8ea8938d5e9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1362 microversion: 2.1 time: 0.217646 Sep 01 14:05:58.310935 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 375/728] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:58 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:58.328792 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-26714e27-91c6-418a-9cea-c1ce12111fcd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:58.330150 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-26714e27-91c6-418a-9cea-c1ce12111fcd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:58.338602 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-26714e27-91c6-418a-9cea-c1ce12111fcd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:58.339095 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-26714e27-91c6-418a-9cea-c1ce12111fcd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:58.341165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-26714e27-91c6-418a-9cea-c1ce12111fcd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:58.341165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-26714e27-91c6-418a-9cea-c1ce12111fcd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:58.341165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-26714e27-91c6-418a-9cea-c1ce12111fcd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:58.341165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-26714e27-91c6-418a-9cea-c1ce12111fcd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:58.549558 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-26714e27-91c6-418a-9cea-c1ce12111fcd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:58.561691 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-26714e27-91c6-418a-9cea-c1ce12111fcd tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.241898 Sep 01 14:05:58.562838 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 354/729] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:58 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:05:58.675010 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3e768c89-7e6d-4153-91ab-c8021b610a3b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:58.675517 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3e768c89-7e6d-4153-91ab-c8021b610a3b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:58.687401 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3e768c89-7e6d-4153-91ab-c8021b610a3b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:58.687401 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3e768c89-7e6d-4153-91ab-c8021b610a3b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:58.687401 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3e768c89-7e6d-4153-91ab-c8021b610a3b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:58.687401 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3e768c89-7e6d-4153-91ab-c8021b610a3b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:58.687744 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3e768c89-7e6d-4153-91ab-c8021b610a3b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:58.687744 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3e768c89-7e6d-4153-91ab-c8021b610a3b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:58.699961 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-ceee88f8-75bf-443e-8a4c-a9d10406c3da req-65267596-acef-4c65-92a3-b35ae8300b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119579c0-e191-42e8-876d-54fc2a73f102", "tag": "96d39b33-549c-4d2d-98ef-d9a4984b2a6d"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:05:58.711124 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ceee88f8-75bf-443e-8a4c-a9d10406c3da req-65267596-acef-4c65-92a3-b35ae8300b5b service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:58.711863 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ceee88f8-75bf-443e-8a4c-a9d10406c3da req-65267596-acef-4c65-92a3-b35ae8300b5b service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:58.712414 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ceee88f8-75bf-443e-8a4c-a9d10406c3da req-65267596-acef-4c65-92a3-b35ae8300b5b service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:58.724155 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-ceee88f8-75bf-443e-8a4c-a9d10406c3da req-65267596-acef-4c65-92a3-b35ae8300b5b service nova] Creating event network-changed:96d39b33-549c-4d2d-98ef-d9a4984b2a6d for instance 119579c0-e191-42e8-876d-54fc2a73f102 on hv-cinder-85221 Sep 01 14:05:58.729728 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-ceee88f8-75bf-443e-8a4c-a9d10406c3da req-65267596-acef-4c65-92a3-b35ae8300b5b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033309 Sep 01 14:05:58.730540 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 355/730] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:05:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:05:58.915900 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3e768c89-7e6d-4153-91ab-c8021b610a3b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:58.930876 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3e768c89-7e6d-4153-91ab-c8021b610a3b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:58.933946 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3e768c89-7e6d-4153-91ab-c8021b610a3b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:05:58.936269 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3e768c89-7e6d-4153-91ab-c8021b610a3b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1598 microversion: 2.20 time: 0.265127 Sep 01 14:05:58.937300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 376/731] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:05:58 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1598 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:05:58.964952 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-856ae918-df0d-465a-ba70-d61ebcdcd335 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:58.965898 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-856ae918-df0d-465a-ba70-d61ebcdcd335 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:58.972993 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-856ae918-df0d-465a-ba70-d61ebcdcd335 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:58.973495 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-856ae918-df0d-465a-ba70-d61ebcdcd335 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:58.973992 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-856ae918-df0d-465a-ba70-d61ebcdcd335 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:58.974766 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-856ae918-df0d-465a-ba70-d61ebcdcd335 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:58.975224 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-856ae918-df0d-465a-ba70-d61ebcdcd335 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:58.975667 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-856ae918-df0d-465a-ba70-d61ebcdcd335 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:59.118556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-856ae918-df0d-465a-ba70-d61ebcdcd335 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.159420 Sep 01 14:05:59.119169 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 356/732] 10.222.0.61 () {60 vars in 1316 bytes} [Thu Sep 1 14:05:58 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 14:05:59.336153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-335003a3-e581-4750-adde-9e512cf3e38f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:59.337447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-335003a3-e581-4750-adde-9e512cf3e38f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:59.344535 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-335003a3-e581-4750-adde-9e512cf3e38f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:59.345130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-335003a3-e581-4750-adde-9e512cf3e38f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:59.345632 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-335003a3-e581-4750-adde-9e512cf3e38f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:59.346458 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-335003a3-e581-4750-adde-9e512cf3e38f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:59.346923 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-335003a3-e581-4750-adde-9e512cf3e38f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:59.347472 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-335003a3-e581-4750-adde-9e512cf3e38f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:59.584827 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-bf44a584-275b-4680-931f-012ca2c5bc7e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:05:59.585438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-bf44a584-275b-4680-931f-012ca2c5bc7e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:05:59.592685 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf44a584-275b-4680-931f-012ca2c5bc7e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:59.593343 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf44a584-275b-4680-931f-012ca2c5bc7e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:59.593803 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf44a584-275b-4680-931f-012ca2c5bc7e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:05:59.594565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf44a584-275b-4680-931f-012ca2c5bc7e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:05:59.595025 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf44a584-275b-4680-931f-012ca2c5bc7e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:05:59.595461 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf44a584-275b-4680-931f-012ca2c5bc7e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:00.034549 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-335003a3-e581-4750-adde-9e512cf3e38f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:00.043924 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-335003a3-e581-4750-adde-9e512cf3e38f tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1362 microversion: 2.1 time: 0.711722 Sep 01 14:06:00.057822 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 377/733] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:59 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1362 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:00.124555 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-bf44a584-275b-4680-931f-012ca2c5bc7e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:00.136173 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-bf44a584-275b-4680-931f-012ca2c5bc7e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.555911 Sep 01 14:06:00.137055 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 357/734] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:05:59 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:00.972553 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-f09b43cf-d7d5-4b22-b954-df6c0a0e379e req-9837f391-0249-4ef6-a505-5ffdc8caa43e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aacf49fd-7b35-4e19-81f0-098fc9d2b0d6", "tag": "fce10985-ae68-4e7b-beef-fef3f597b453"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:00.984374 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f09b43cf-d7d5-4b22-b954-df6c0a0e379e req-9837f391-0249-4ef6-a505-5ffdc8caa43e service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:00.984991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f09b43cf-d7d5-4b22-b954-df6c0a0e379e req-9837f391-0249-4ef6-a505-5ffdc8caa43e service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:00.985516 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f09b43cf-d7d5-4b22-b954-df6c0a0e379e req-9837f391-0249-4ef6-a505-5ffdc8caa43e service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:00.999441 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-f09b43cf-d7d5-4b22-b954-df6c0a0e379e req-9837f391-0249-4ef6-a505-5ffdc8caa43e service nova] Creating event network-changed:fce10985-ae68-4e7b-beef-fef3f597b453 for instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 on hv-cinder-85221 Sep 01 14:06:01.005135 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-f09b43cf-d7d5-4b22-b954-df6c0a0e379e req-9837f391-0249-4ef6-a505-5ffdc8caa43e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036657 Sep 01 14:06:01.006031 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 378/735] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:01.080433 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-00990608-3911-4445-91b9-beb2da538b9a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:01.081400 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-00990608-3911-4445-91b9-beb2da538b9a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:01.089844 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-00990608-3911-4445-91b9-beb2da538b9a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:01.090498 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-00990608-3911-4445-91b9-beb2da538b9a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:01.091040 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-00990608-3911-4445-91b9-beb2da538b9a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:01.092034 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-00990608-3911-4445-91b9-beb2da538b9a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:01.092595 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-00990608-3911-4445-91b9-beb2da538b9a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:01.093119 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-00990608-3911-4445-91b9-beb2da538b9a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:01.118421 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:01.163316 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b983de2f-bfcc-4ffe-90ec-b6cd9f62c25a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:01.164458 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b983de2f-bfcc-4ffe-90ec-b6cd9f62c25a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:01.172279 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b983de2f-bfcc-4ffe-90ec-b6cd9f62c25a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:01.173139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b983de2f-bfcc-4ffe-90ec-b6cd9f62c25a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:01.173822 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b983de2f-bfcc-4ffe-90ec-b6cd9f62c25a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:01.174651 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b983de2f-bfcc-4ffe-90ec-b6cd9f62c25a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:01.175189 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b983de2f-bfcc-4ffe-90ec-b6cd9f62c25a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:01.175703 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b983de2f-bfcc-4ffe-90ec-b6cd9f62c25a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:01.297522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-00990608-3911-4445-91b9-beb2da538b9a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:01.310149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-00990608-3911-4445-91b9-beb2da538b9a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1362 microversion: 2.1 time: 0.234034 Sep 01 14:06:01.312543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 358/736] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:01 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:01.372093 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-b983de2f-bfcc-4ffe-90ec-b6cd9f62c25a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:01.384229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b983de2f-bfcc-4ffe-90ec-b6cd9f62c25a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.225807 Sep 01 14:06:01.385563 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 379/737] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:01 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:02.291500 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:02.296248 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c2fb1e7a-d009-4c45-9a10-2bdb8624e4a2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:02.298687 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c2fb1e7a-d009-4c45-9a10-2bdb8624e4a2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:02.306265 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2fb1e7a-d009-4c45-9a10-2bdb8624e4a2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:02.306768 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2fb1e7a-d009-4c45-9a10-2bdb8624e4a2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:02.307275 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2fb1e7a-d009-4c45-9a10-2bdb8624e4a2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:02.307994 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2fb1e7a-d009-4c45-9a10-2bdb8624e4a2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:02.308460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2fb1e7a-d009-4c45-9a10-2bdb8624e4a2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:02.308897 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c2fb1e7a-d009-4c45-9a10-2bdb8624e4a2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:02.332968 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-da8bd189-343d-4940-a6f1-e4b06f877ee7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:02.333526 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-da8bd189-343d-4940-a6f1-e4b06f877ee7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:02.343594 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-da8bd189-343d-4940-a6f1-e4b06f877ee7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:02.344082 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-c2fb1e7a-d009-4c45-9a10-2bdb8624e4a2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'flavor' on Instance uuid 901d0282-c949-4f4d-9f04-7141c3b42480 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:06:02.344366 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-da8bd189-343d-4940-a6f1-e4b06f877ee7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:02.344943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-da8bd189-343d-4940-a6f1-e4b06f877ee7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:02.345763 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-da8bd189-343d-4940-a6f1-e4b06f877ee7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:02.346411 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-da8bd189-343d-4940-a6f1-e4b06f877ee7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:02.346883 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-da8bd189-343d-4940-a6f1-e4b06f877ee7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:02.513093 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=22 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:02.596361 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-da8bd189-343d-4940-a6f1-e4b06f877ee7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:02.606434 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-da8bd189-343d-4940-a6f1-e4b06f877ee7 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1362 microversion: 2.1 time: 0.277521 Sep 01 14:06:02.606891 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 380/738] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:02 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:02.611737 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-55125cc8-23ac-4693-81a3-e7f8de7f822e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:02.612337 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-55125cc8-23ac-4693-81a3-e7f8de7f822e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:02.619331 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55125cc8-23ac-4693-81a3-e7f8de7f822e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:02.619825 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55125cc8-23ac-4693-81a3-e7f8de7f822e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:02.620257 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55125cc8-23ac-4693-81a3-e7f8de7f822e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:02.620956 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55125cc8-23ac-4693-81a3-e7f8de7f822e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:02.621411 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55125cc8-23ac-4693-81a3-e7f8de7f822e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:02.621871 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55125cc8-23ac-4693-81a3-e7f8de7f822e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:02.795219 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c2fb1e7a-d009-4c45-9a10-2bdb8624e4a2 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "POST /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/action" status: 200 len: 32 microversion: 2.1 time: 0.505507 Sep 01 14:06:02.797986 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 359/739] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:06:02 2022] POST /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/action => generated 32 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:06:02.815174 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-bd546af5-1df0-43b0-a1bb-44a50901b2d1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:02.815875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-bd546af5-1df0-43b0-a1bb-44a50901b2d1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:02.824712 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bd546af5-1df0-43b0-a1bb-44a50901b2d1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:02.825187 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bd546af5-1df0-43b0-a1bb-44a50901b2d1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:02.825621 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bd546af5-1df0-43b0-a1bb-44a50901b2d1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:02.826366 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bd546af5-1df0-43b0-a1bb-44a50901b2d1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:02.826812 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bd546af5-1df0-43b0-a1bb-44a50901b2d1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:02.827462 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bd546af5-1df0-43b0-a1bb-44a50901b2d1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:02.866086 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-55125cc8-23ac-4693-81a3-e7f8de7f822e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:02.876383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-55125cc8-23ac-4693-81a3-e7f8de7f822e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.267942 Sep 01 14:06:02.876971 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 381/740] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:02 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:03.133411 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-bd546af5-1df0-43b0-a1bb-44a50901b2d1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:03.141365 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-678cd788-716b-4629-916b-24d1ae0d14a2 req-46dcf09e-caaf-477f-975f-fc56d364eb5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec24f5b-aec6-406b-bf20-dd2e3d4e8438", "name": "network-vif-plugged", "status": "completed", "tag": "b21bbade-8af9-44b2-960e-25704dbd478c"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:03.148253 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-bd546af5-1df0-43b0-a1bb-44a50901b2d1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.336881 Sep 01 14:06:03.149826 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 360/741] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:02 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:03.158675 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-678cd788-716b-4629-916b-24d1ae0d14a2 req-46dcf09e-caaf-477f-975f-fc56d364eb5f service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:03.159527 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-678cd788-716b-4629-916b-24d1ae0d14a2 req-46dcf09e-caaf-477f-975f-fc56d364eb5f service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:03.160046 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-678cd788-716b-4629-916b-24d1ae0d14a2 req-46dcf09e-caaf-477f-975f-fc56d364eb5f service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:03.173649 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-678cd788-716b-4629-916b-24d1ae0d14a2 req-46dcf09e-caaf-477f-975f-fc56d364eb5f service nova] Creating event network-vif-plugged:b21bbade-8af9-44b2-960e-25704dbd478c for instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 on hv-cinder-85221 Sep 01 14:06:03.178729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-678cd788-716b-4629-916b-24d1ae0d14a2 req-46dcf09e-caaf-477f-975f-fc56d364eb5f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046032 Sep 01 14:06:03.179337 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 382/742] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:03.628351 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d9dda671-be70-4937-b5d9-b86387b3f64a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:03.629146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d9dda671-be70-4937-b5d9-b86387b3f64a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:03.636502 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d9dda671-be70-4937-b5d9-b86387b3f64a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:03.636995 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d9dda671-be70-4937-b5d9-b86387b3f64a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:03.637427 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d9dda671-be70-4937-b5d9-b86387b3f64a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:03.638174 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d9dda671-be70-4937-b5d9-b86387b3f64a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:03.638687 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d9dda671-be70-4937-b5d9-b86387b3f64a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:03.639289 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d9dda671-be70-4937-b5d9-b86387b3f64a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:03.826675 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d9dda671-be70-4937-b5d9-b86387b3f64a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:03.835082 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d9dda671-be70-4937-b5d9-b86387b3f64a tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1362 microversion: 2.1 time: 0.210786 Sep 01 14:06:03.840384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 361/743] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:03 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1362 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:03.897484 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:03.902961 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-38bc8010-3d9d-43b5-8583-ce2da83b6e06 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:03.903701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-38bc8010-3d9d-43b5-8583-ce2da83b6e06 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:03.910739 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-38bc8010-3d9d-43b5-8583-ce2da83b6e06 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:03.911208 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-38bc8010-3d9d-43b5-8583-ce2da83b6e06 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:03.911674 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-38bc8010-3d9d-43b5-8583-ce2da83b6e06 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:03.912388 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-38bc8010-3d9d-43b5-8583-ce2da83b6e06 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:03.912845 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-38bc8010-3d9d-43b5-8583-ce2da83b6e06 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:03.913273 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-38bc8010-3d9d-43b5-8583-ce2da83b6e06 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:04.098590 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-38bc8010-3d9d-43b5-8583-ce2da83b6e06 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:04.106865 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-38bc8010-3d9d-43b5-8583-ce2da83b6e06 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.210973 Sep 01 14:06:04.107459 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 383/744] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:03 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:04.170571 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7c0acaa2-6d06-4b5b-9116-d5e919a55a60 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:04.171206 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7c0acaa2-6d06-4b5b-9116-d5e919a55a60 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:04.177443 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7c0acaa2-6d06-4b5b-9116-d5e919a55a60 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:04.177970 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7c0acaa2-6d06-4b5b-9116-d5e919a55a60 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:04.180533 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7c0acaa2-6d06-4b5b-9116-d5e919a55a60 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:04.180533 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7c0acaa2-6d06-4b5b-9116-d5e919a55a60 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:04.180533 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7c0acaa2-6d06-4b5b-9116-d5e919a55a60 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:04.180533 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7c0acaa2-6d06-4b5b-9116-d5e919a55a60 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:04.318732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7c0acaa2-6d06-4b5b-9116-d5e919a55a60 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:04.328199 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7c0acaa2-6d06-4b5b-9116-d5e919a55a60 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.161402 Sep 01 14:06:04.328791 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 362/745] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:04 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:04.858192 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ac0c661a-847a-492a-893f-4ecda52f1af0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:04.858813 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ac0c661a-847a-492a-893f-4ecda52f1af0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:04.865439 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ac0c661a-847a-492a-893f-4ecda52f1af0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:04.865963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ac0c661a-847a-492a-893f-4ecda52f1af0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:04.866412 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ac0c661a-847a-492a-893f-4ecda52f1af0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:04.867131 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ac0c661a-847a-492a-893f-4ecda52f1af0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:04.868233 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ac0c661a-847a-492a-893f-4ecda52f1af0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:04.868669 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ac0c661a-847a-492a-893f-4ecda52f1af0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:05.011164 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ac0c661a-847a-492a-893f-4ecda52f1af0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:05.019512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ac0c661a-847a-492a-893f-4ecda52f1af0 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1362 microversion: 2.1 time: 0.165280 Sep 01 14:06:05.020097 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 384/746] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:04 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:05.127458 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-31b766de-68e9-455e-9003-4b7d44ec741e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:05.130139 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-31b766de-68e9-455e-9003-4b7d44ec741e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:05.134300 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31b766de-68e9-455e-9003-4b7d44ec741e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:05.134779 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31b766de-68e9-455e-9003-4b7d44ec741e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:05.135210 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31b766de-68e9-455e-9003-4b7d44ec741e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:05.135957 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31b766de-68e9-455e-9003-4b7d44ec741e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:05.136420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31b766de-68e9-455e-9003-4b7d44ec741e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:05.136835 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31b766de-68e9-455e-9003-4b7d44ec741e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:05.317962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-31b766de-68e9-455e-9003-4b7d44ec741e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:05.334311 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-31b766de-68e9-455e-9003-4b7d44ec741e tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1265 microversion: 2.1 time: 0.210860 Sep 01 14:06:05.335800 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 363/747] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:05 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:05.358151 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f16e88bd-b447-4fd2-828f-e56be746774d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:05.358777 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f16e88bd-b447-4fd2-828f-e56be746774d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:05.365287 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f16e88bd-b447-4fd2-828f-e56be746774d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:05.365815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f16e88bd-b447-4fd2-828f-e56be746774d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:05.366260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f16e88bd-b447-4fd2-828f-e56be746774d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:05.367130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f16e88bd-b447-4fd2-828f-e56be746774d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:05.367626 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f16e88bd-b447-4fd2-828f-e56be746774d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:05.368057 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f16e88bd-b447-4fd2-828f-e56be746774d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:05.530422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f16e88bd-b447-4fd2-828f-e56be746774d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:05.543022 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f16e88bd-b447-4fd2-828f-e56be746774d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.188821 Sep 01 14:06:05.544572 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 385/748] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:05 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:06.041830 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2e42c6c6-1685-4ba0-95fb-8d19d3abd041 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:06.042328 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2e42c6c6-1685-4ba0-95fb-8d19d3abd041 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:06.049267 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2e42c6c6-1685-4ba0-95fb-8d19d3abd041 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:06.049734 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2e42c6c6-1685-4ba0-95fb-8d19d3abd041 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:06.050200 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2e42c6c6-1685-4ba0-95fb-8d19d3abd041 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:06.050915 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2e42c6c6-1685-4ba0-95fb-8d19d3abd041 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:06.051469 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2e42c6c6-1685-4ba0-95fb-8d19d3abd041 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:06.051983 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2e42c6c6-1685-4ba0-95fb-8d19d3abd041 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:06.196384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2e42c6c6-1685-4ba0-95fb-8d19d3abd041 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:06.204962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2e42c6c6-1685-4ba0-95fb-8d19d3abd041 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1362 microversion: 2.1 time: 0.167141 Sep 01 14:06:06.205546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 364/749] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:06 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:06.356354 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5ef09b74-30b1-4a13-aa89-1e1bc5a3d6ca tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:06.356962 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-5ef09b74-30b1-4a13-aa89-1e1bc5a3d6ca tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:06.363475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ef09b74-30b1-4a13-aa89-1e1bc5a3d6ca tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:06.363958 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ef09b74-30b1-4a13-aa89-1e1bc5a3d6ca tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:06.364399 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ef09b74-30b1-4a13-aa89-1e1bc5a3d6ca tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:06.365094 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ef09b74-30b1-4a13-aa89-1e1bc5a3d6ca tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:06.365540 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ef09b74-30b1-4a13-aa89-1e1bc5a3d6ca tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:06.366986 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5ef09b74-30b1-4a13-aa89-1e1bc5a3d6ca tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:06.512401 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5ef09b74-30b1-4a13-aa89-1e1bc5a3d6ca tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:06.522236 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-5ef09b74-30b1-4a13-aa89-1e1bc5a3d6ca tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1452 microversion: 2.1 time: 0.169902 Sep 01 14:06:06.522932 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 386/750] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:06 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:06.543863 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4e0982e0-b641-472e-990d-0f691992cec1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:06.544484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4e0982e0-b641-472e-990d-0f691992cec1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:06.551051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4e0982e0-b641-472e-990d-0f691992cec1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:06.551551 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4e0982e0-b641-472e-990d-0f691992cec1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:06.552000 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4e0982e0-b641-472e-990d-0f691992cec1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:06.552724 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4e0982e0-b641-472e-990d-0f691992cec1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:06.553279 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4e0982e0-b641-472e-990d-0f691992cec1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:06.553714 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4e0982e0-b641-472e-990d-0f691992cec1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:06.568366 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-bca4c634-061e-47ff-9787-d9848ad5a04e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:06.568978 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-bca4c634-061e-47ff-9787-d9848ad5a04e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:06.577225 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bca4c634-061e-47ff-9787-d9848ad5a04e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:06.577935 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bca4c634-061e-47ff-9787-d9848ad5a04e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:06.578563 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bca4c634-061e-47ff-9787-d9848ad5a04e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:06.579350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bca4c634-061e-47ff-9787-d9848ad5a04e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:06.579864 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bca4c634-061e-47ff-9787-d9848ad5a04e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:06.580358 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bca4c634-061e-47ff-9787-d9848ad5a04e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:06.763948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4e0982e0-b641-472e-990d-0f691992cec1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:06.772157 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4e0982e0-b641-472e-990d-0f691992cec1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1452 microversion: 2.1 time: 0.232306 Sep 01 14:06:06.772855 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 365/751] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:06 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1452 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:06.776086 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-bca4c634-061e-47ff-9787-d9848ad5a04e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:06.784582 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-bca4c634-061e-47ff-9787-d9848ad5a04e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.220202 Sep 01 14:06:06.785167 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 387/752] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:06 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:07.212452 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-fb8b39d9-bc8e-4b2d-a01e-992ff5e9cd3c req-b3219fe3-02fe-4ac0-be2f-6aa3c5921b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119579c0-e191-42e8-876d-54fc2a73f102", "name": "network-vif-plugged", "status": "completed", "tag": "96d39b33-549c-4d2d-98ef-d9a4984b2a6d"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:07.229158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-fb8b39d9-bc8e-4b2d-a01e-992ff5e9cd3c req-b3219fe3-02fe-4ac0-be2f-6aa3c5921b5d service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:07.230006 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-fb8b39d9-bc8e-4b2d-a01e-992ff5e9cd3c req-b3219fe3-02fe-4ac0-be2f-6aa3c5921b5d service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:07.230574 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cd55d0c1-45d6-4f98-bf29-de24079bfd47 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:07.231041 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-fb8b39d9-bc8e-4b2d-a01e-992ff5e9cd3c req-b3219fe3-02fe-4ac0-be2f-6aa3c5921b5d service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:07.231192 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-cd55d0c1-45d6-4f98-bf29-de24079bfd47 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:07.240025 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cd55d0c1-45d6-4f98-bf29-de24079bfd47 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:07.240518 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cd55d0c1-45d6-4f98-bf29-de24079bfd47 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:07.240950 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cd55d0c1-45d6-4f98-bf29-de24079bfd47 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:07.241671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cd55d0c1-45d6-4f98-bf29-de24079bfd47 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:07.242166 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cd55d0c1-45d6-4f98-bf29-de24079bfd47 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:07.243468 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cd55d0c1-45d6-4f98-bf29-de24079bfd47 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:07.247573 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-fb8b39d9-bc8e-4b2d-a01e-992ff5e9cd3c req-b3219fe3-02fe-4ac0-be2f-6aa3c5921b5d service nova] Creating event network-vif-plugged:96d39b33-549c-4d2d-98ef-d9a4984b2a6d for instance 119579c0-e191-42e8-876d-54fc2a73f102 on hv-cinder-85221 Sep 01 14:06:07.254734 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-fb8b39d9-bc8e-4b2d-a01e-992ff5e9cd3c req-b3219fe3-02fe-4ac0-be2f-6aa3c5921b5d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046644 Sep 01 14:06:07.255607 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 366/753] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:07.741597 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cd55d0c1-45d6-4f98-bf29-de24079bfd47 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:07.750351 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cd55d0c1-45d6-4f98-bf29-de24079bfd47 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1362 microversion: 2.1 time: 0.523578 Sep 01 14:06:07.751436 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 388/754] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:07 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1362 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:07.806999 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7bb81611-c2c8-476e-b885-a55118306f21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:07.807714 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7bb81611-c2c8-476e-b885-a55118306f21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:07.814022 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7bb81611-c2c8-476e-b885-a55118306f21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:07.814510 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7bb81611-c2c8-476e-b885-a55118306f21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:07.814946 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7bb81611-c2c8-476e-b885-a55118306f21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:07.815673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7bb81611-c2c8-476e-b885-a55118306f21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:07.816126 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7bb81611-c2c8-476e-b885-a55118306f21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:07.816550 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7bb81611-c2c8-476e-b885-a55118306f21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:08.013812 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7bb81611-c2c8-476e-b885-a55118306f21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:08.023764 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7bb81611-c2c8-476e-b885-a55118306f21 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.220840 Sep 01 14:06:08.034265 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 367/755] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:07 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:08.338607 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8b67e220-07aa-41eb-9a79-81c887b5bddb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:08.339208 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8b67e220-07aa-41eb-9a79-81c887b5bddb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:08.345573 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b67e220-07aa-41eb-9a79-81c887b5bddb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:08.346198 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b67e220-07aa-41eb-9a79-81c887b5bddb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:08.346722 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b67e220-07aa-41eb-9a79-81c887b5bddb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:08.347643 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b67e220-07aa-41eb-9a79-81c887b5bddb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:08.348062 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b67e220-07aa-41eb-9a79-81c887b5bddb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:08.348564 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b67e220-07aa-41eb-9a79-81c887b5bddb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:08.375243 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8b67e220-07aa-41eb-9a79-81c887b5bddb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/ips" status: 200 len: 150 microversion: 2.1 time: 0.172563 Sep 01 14:06:08.376434 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 389/756] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 1 14:06:08 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/ips => generated 150 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:08.772649 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8c8a68e7-765e-4296-8f0e-ae62a215104b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:08.773209 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8c8a68e7-765e-4296-8f0e-ae62a215104b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:08.780152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8c8a68e7-765e-4296-8f0e-ae62a215104b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:08.780639 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8c8a68e7-765e-4296-8f0e-ae62a215104b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:08.781116 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8c8a68e7-765e-4296-8f0e-ae62a215104b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:08.781990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8c8a68e7-765e-4296-8f0e-ae62a215104b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:08.782439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8c8a68e7-765e-4296-8f0e-ae62a215104b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:08.782867 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8c8a68e7-765e-4296-8f0e-ae62a215104b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:08.995443 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8c8a68e7-765e-4296-8f0e-ae62a215104b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:09.004311 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8c8a68e7-765e-4296-8f0e-ae62a215104b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1362 microversion: 2.1 time: 0.235645 Sep 01 14:06:09.017999 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 368/757] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:08 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:09.051436 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-78d4ae0e-d41e-47e0-8935-756a1a36c577 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:09.051436 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-78d4ae0e-d41e-47e0-8935-756a1a36c577 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:09.059418 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-78d4ae0e-d41e-47e0-8935-756a1a36c577 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:09.060045 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-78d4ae0e-d41e-47e0-8935-756a1a36c577 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:09.060559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-78d4ae0e-d41e-47e0-8935-756a1a36c577 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:09.062611 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-78d4ae0e-d41e-47e0-8935-756a1a36c577 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:09.063222 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-78d4ae0e-d41e-47e0-8935-756a1a36c577 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:09.064098 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-78d4ae0e-d41e-47e0-8935-756a1a36c577 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:09.307835 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-78d4ae0e-d41e-47e0-8935-756a1a36c577 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:09.322894 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-78d4ae0e-d41e-47e0-8935-756a1a36c577 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.281569 Sep 01 14:06:09.325705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 390/758] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:09 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:09.703091 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-fcc204c0-5a0f-4d1a-90c8-51effb66f7b3 req-a8aa0cb4-4c40-4d2d-b96a-df6e5930cfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ec24f5b-aec6-406b-bf20-dd2e3d4e8438", "tag": "b21bbade-8af9-44b2-960e-25704dbd478c"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:09.713745 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-fcc204c0-5a0f-4d1a-90c8-51effb66f7b3 req-a8aa0cb4-4c40-4d2d-b96a-df6e5930cfb1 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:09.714250 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-fcc204c0-5a0f-4d1a-90c8-51effb66f7b3 req-a8aa0cb4-4c40-4d2d-b96a-df6e5930cfb1 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:09.714662 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-fcc204c0-5a0f-4d1a-90c8-51effb66f7b3 req-a8aa0cb4-4c40-4d2d-b96a-df6e5930cfb1 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:09.725973 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-fcc204c0-5a0f-4d1a-90c8-51effb66f7b3 req-a8aa0cb4-4c40-4d2d-b96a-df6e5930cfb1 service nova] Creating event network-changed:b21bbade-8af9-44b2-960e-25704dbd478c for instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 on hv-cinder-85221 Sep 01 14:06:09.731146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-fcc204c0-5a0f-4d1a-90c8-51effb66f7b3 req-a8aa0cb4-4c40-4d2d-b96a-df6e5930cfb1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031732 Sep 01 14:06:09.732044 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 369/759] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:10.028505 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d14b0a86-e836-4ecc-b66d-af709bac4931 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:10.029145 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d14b0a86-e836-4ecc-b66d-af709bac4931 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:10.048789 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d14b0a86-e836-4ecc-b66d-af709bac4931 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:10.051101 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d14b0a86-e836-4ecc-b66d-af709bac4931 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:10.052038 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d14b0a86-e836-4ecc-b66d-af709bac4931 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:10.057730 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d14b0a86-e836-4ecc-b66d-af709bac4931 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:10.059141 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d14b0a86-e836-4ecc-b66d-af709bac4931 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:10.061544 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d14b0a86-e836-4ecc-b66d-af709bac4931 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:10.093901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:10.209460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-527b7845-9e35-473b-b2cf-fe57809ac0dc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "585f3190-d655-4800-a94d-ead46d34b9c5"}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:10.228145 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-527b7845-9e35-473b-b2cf-fe57809ac0dc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:10.242159 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-527b7845-9e35-473b-b2cf-fe57809ac0dc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:10.243577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-527b7845-9e35-473b-b2cf-fe57809ac0dc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:10.244635 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-527b7845-9e35-473b-b2cf-fe57809ac0dc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:10.246027 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-527b7845-9e35-473b-b2cf-fe57809ac0dc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:10.247154 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-527b7845-9e35-473b-b2cf-fe57809ac0dc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:10.247957 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-527b7845-9e35-473b-b2cf-fe57809ac0dc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:10.311811 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d14b0a86-e836-4ecc-b66d-af709bac4931 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:10.326049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d14b0a86-e836-4ecc-b66d-af709bac4931 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1362 microversion: 2.1 time: 0.303140 Sep 01 14:06:10.348724 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 391/760] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:10 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:10.354060 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1741874b-36c8-477f-95b8-382697adb5c9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:10.354679 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1741874b-36c8-477f-95b8-382697adb5c9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:10.362960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1741874b-36c8-477f-95b8-382697adb5c9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:10.363458 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1741874b-36c8-477f-95b8-382697adb5c9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:10.363904 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1741874b-36c8-477f-95b8-382697adb5c9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:10.364663 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1741874b-36c8-477f-95b8-382697adb5c9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:10.365104 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1741874b-36c8-477f-95b8-382697adb5c9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:10.365556 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1741874b-36c8-477f-95b8-382697adb5c9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:10.611792 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1741874b-36c8-477f-95b8-382697adb5c9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:10.622375 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1741874b-36c8-477f-95b8-382697adb5c9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.272373 Sep 01 14:06:10.629718 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 392/761] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:10 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:11.236319 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-527b7845-9e35-473b-b2cf-fe57809ac0dc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "POST /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.036063 Sep 01 14:06:11.237011 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 370/762] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:06:10 2022] POST /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments => generated 194 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:11.355350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f4c63f3f-8ddc-44ac-9e83-682c1c32e073 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:11.355982 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f4c63f3f-8ddc-44ac-9e83-682c1c32e073 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:11.363091 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f4c63f3f-8ddc-44ac-9e83-682c1c32e073 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:11.363604 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f4c63f3f-8ddc-44ac-9e83-682c1c32e073 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:11.364055 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f4c63f3f-8ddc-44ac-9e83-682c1c32e073 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:11.364790 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f4c63f3f-8ddc-44ac-9e83-682c1c32e073 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:11.365261 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f4c63f3f-8ddc-44ac-9e83-682c1c32e073 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:11.365695 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f4c63f3f-8ddc-44ac-9e83-682c1c32e073 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:11.509381 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f4c63f3f-8ddc-44ac-9e83-682c1c32e073 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:11.517816 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f4c63f3f-8ddc-44ac-9e83-682c1c32e073 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1548 microversion: 2.1 time: 0.166699 Sep 01 14:06:11.518587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 393/763] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:11 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:11.539664 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8fc1f86a-622b-4495-b686-43fed0b64cdf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:11.540251 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8fc1f86a-622b-4495-b686-43fed0b64cdf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:11.547070 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8fc1f86a-622b-4495-b686-43fed0b64cdf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:11.547557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8fc1f86a-622b-4495-b686-43fed0b64cdf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:11.547987 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8fc1f86a-622b-4495-b686-43fed0b64cdf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:11.548688 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8fc1f86a-622b-4495-b686-43fed0b64cdf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:11.549136 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8fc1f86a-622b-4495-b686-43fed0b64cdf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:11.549551 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8fc1f86a-622b-4495-b686-43fed0b64cdf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:11.636794 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8fc1f86a-622b-4495-b686-43fed0b64cdf tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101566 Sep 01 14:06:11.637584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 371/764] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 1 14:06:11 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:11.651587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e590d6c9-12d2-4e5f-bfee-6544181b62a8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:11.652215 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e590d6c9-12d2-4e5f-bfee-6544181b62a8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:11.658354 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e590d6c9-12d2-4e5f-bfee-6544181b62a8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:11.658846 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e590d6c9-12d2-4e5f-bfee-6544181b62a8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:11.659284 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e590d6c9-12d2-4e5f-bfee-6544181b62a8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:11.659985 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e590d6c9-12d2-4e5f-bfee-6544181b62a8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:11.660438 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e590d6c9-12d2-4e5f-bfee-6544181b62a8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:11.660857 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e590d6c9-12d2-4e5f-bfee-6544181b62a8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:11.936596 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e590d6c9-12d2-4e5f-bfee-6544181b62a8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:11.945967 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e590d6c9-12d2-4e5f-bfee-6544181b62a8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.299017 Sep 01 14:06:11.946658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 394/765] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:11 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:12.968523 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1ea70d9f-f721-4b20-8b9d-f4bf1de22d9f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:12.969145 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1ea70d9f-f721-4b20-8b9d-f4bf1de22d9f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:12.975509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1ea70d9f-f721-4b20-8b9d-f4bf1de22d9f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:12.976003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1ea70d9f-f721-4b20-8b9d-f4bf1de22d9f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:12.976443 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1ea70d9f-f721-4b20-8b9d-f4bf1de22d9f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:12.977150 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1ea70d9f-f721-4b20-8b9d-f4bf1de22d9f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:12.977606 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1ea70d9f-f721-4b20-8b9d-f4bf1de22d9f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:12.978061 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1ea70d9f-f721-4b20-8b9d-f4bf1de22d9f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:13.202920 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1ea70d9f-f721-4b20-8b9d-f4bf1de22d9f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:13.216116 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1ea70d9f-f721-4b20-8b9d-f4bf1de22d9f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.252321 Sep 01 14:06:13.217697 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 372/766] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:12 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:13.264441 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-34215da9-3d26-435b-a27b-186fe48828b1 req-a88fbd03-9343-49b5-b80a-3bba0fea50f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119579c0-e191-42e8-876d-54fc2a73f102", "tag": "96d39b33-549c-4d2d-98ef-d9a4984b2a6d"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:13.275003 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-34215da9-3d26-435b-a27b-186fe48828b1 req-a88fbd03-9343-49b5-b80a-3bba0fea50f0 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:13.275488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-34215da9-3d26-435b-a27b-186fe48828b1 req-a88fbd03-9343-49b5-b80a-3bba0fea50f0 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:13.275933 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-34215da9-3d26-435b-a27b-186fe48828b1 req-a88fbd03-9343-49b5-b80a-3bba0fea50f0 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:13.288799 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-34215da9-3d26-435b-a27b-186fe48828b1 req-a88fbd03-9343-49b5-b80a-3bba0fea50f0 service nova] Creating event network-changed:96d39b33-549c-4d2d-98ef-d9a4984b2a6d for instance 119579c0-e191-42e8-876d-54fc2a73f102 on hv-cinder-85221 Sep 01 14:06:13.294380 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-34215da9-3d26-435b-a27b-186fe48828b1 req-a88fbd03-9343-49b5-b80a-3bba0fea50f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109269 Sep 01 14:06:13.295001 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 395/767] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:14.243862 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4f3e6928-c0c9-4b93-be5c-b0bd87b9f5c8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:14.244583 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4f3e6928-c0c9-4b93-be5c-b0bd87b9f5c8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:14.252122 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f3e6928-c0c9-4b93-be5c-b0bd87b9f5c8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:14.252644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f3e6928-c0c9-4b93-be5c-b0bd87b9f5c8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:14.253083 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f3e6928-c0c9-4b93-be5c-b0bd87b9f5c8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:14.253823 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f3e6928-c0c9-4b93-be5c-b0bd87b9f5c8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:14.254285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f3e6928-c0c9-4b93-be5c-b0bd87b9f5c8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:14.254742 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4f3e6928-c0c9-4b93-be5c-b0bd87b9f5c8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:14.276911 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:14.415728 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4f3e6928-c0c9-4b93-be5c-b0bd87b9f5c8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:14.424482 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4f3e6928-c0c9-4b93-be5c-b0bd87b9f5c8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.185293 Sep 01 14:06:14.425068 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 373/768] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:14 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:15.447395 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0b3073fb-4b90-49b3-860d-553ea702c399 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:15.448147 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0b3073fb-4b90-49b3-860d-553ea702c399 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:15.454683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0b3073fb-4b90-49b3-860d-553ea702c399 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:15.455167 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0b3073fb-4b90-49b3-860d-553ea702c399 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:15.455603 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0b3073fb-4b90-49b3-860d-553ea702c399 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:15.456291 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0b3073fb-4b90-49b3-860d-553ea702c399 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:15.456738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0b3073fb-4b90-49b3-860d-553ea702c399 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:15.457158 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0b3073fb-4b90-49b3-860d-553ea702c399 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:15.607653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0b3073fb-4b90-49b3-860d-553ea702c399 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:15.618174 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0b3073fb-4b90-49b3-860d-553ea702c399 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.175042 Sep 01 14:06:15.618768 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 396/769] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:15 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:16.646108 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ddd76a17-cc8f-46d3-9b0d-1689eb28d9e5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:16.646108 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ddd76a17-cc8f-46d3-9b0d-1689eb28d9e5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:16.647561 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ddd76a17-cc8f-46d3-9b0d-1689eb28d9e5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:16.648058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ddd76a17-cc8f-46d3-9b0d-1689eb28d9e5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:16.650128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ddd76a17-cc8f-46d3-9b0d-1689eb28d9e5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:16.650128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ddd76a17-cc8f-46d3-9b0d-1689eb28d9e5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:16.650366 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ddd76a17-cc8f-46d3-9b0d-1689eb28d9e5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:16.650689 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ddd76a17-cc8f-46d3-9b0d-1689eb28d9e5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:16.786736 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ddd76a17-cc8f-46d3-9b0d-1689eb28d9e5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:16.795166 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ddd76a17-cc8f-46d3-9b0d-1689eb28d9e5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.158797 Sep 01 14:06:16.795754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 374/770] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:16 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:17.621250 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d7711a33-49f1-4246-b1c7-cafbfcd81a77 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-873904408"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:17.621963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d7711a33-49f1-4246-b1c7-cafbfcd81a77 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:17.629779 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7711a33-49f1-4246-b1c7-cafbfcd81a77 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:17.630288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7711a33-49f1-4246-b1c7-cafbfcd81a77 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:17.630723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7711a33-49f1-4246-b1c7-cafbfcd81a77 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:17.631431 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7711a33-49f1-4246-b1c7-cafbfcd81a77 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:17.631882 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7711a33-49f1-4246-b1c7-cafbfcd81a77 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:17.632324 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d7711a33-49f1-4246-b1c7-cafbfcd81a77 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:17.797417 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.network.security_group_api [None req-d7711a33-49f1-4246-b1c7-cafbfcd81a77 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Removing security group b58b42ff-324a-40fc-9c5c-a37b4f1bd914 from port 095e75e8-b9ca-4c49-8292-9f9586ad794f Sep 01 14:06:17.816876 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9bda15d8-8a8b-4428-b257-6dadf20b1681 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:17.817878 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9bda15d8-8a8b-4428-b257-6dadf20b1681 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:17.824367 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9bda15d8-8a8b-4428-b257-6dadf20b1681 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:17.824861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9bda15d8-8a8b-4428-b257-6dadf20b1681 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:17.825302 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9bda15d8-8a8b-4428-b257-6dadf20b1681 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:17.826138 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9bda15d8-8a8b-4428-b257-6dadf20b1681 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:17.826593 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9bda15d8-8a8b-4428-b257-6dadf20b1681 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:17.827017 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9bda15d8-8a8b-4428-b257-6dadf20b1681 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:18.079471 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9bda15d8-8a8b-4428-b257-6dadf20b1681 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:18.089627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9bda15d8-8a8b-4428-b257-6dadf20b1681 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.276488 Sep 01 14:06:18.090430 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 375/771] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:17 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:18.319623 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d7711a33-49f1-4246-b1c7-cafbfcd81a77 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "POST /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/action" status: 202 len: 0 microversion: 2.1 time: 0.702989 Sep 01 14:06:18.320568 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 397/772] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:06:17 2022] POST /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/action => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:06:18.334275 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-ff41ee16-f88d-45fc-a45a-43bc9a15375e req-f512ec6a-db88-49cb-8908-8cc80197c793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d699cea-9245-405e-87bb-0c9e6af9391b", "tag": "095e75e8-b9ca-4c49-8292-9f9586ad794f"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:18.360735 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ff41ee16-f88d-45fc-a45a-43bc9a15375e req-f512ec6a-db88-49cb-8908-8cc80197c793 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:18.364658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ff41ee16-f88d-45fc-a45a-43bc9a15375e req-f512ec6a-db88-49cb-8908-8cc80197c793 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:18.364658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ff41ee16-f88d-45fc-a45a-43bc9a15375e req-f512ec6a-db88-49cb-8908-8cc80197c793 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:18.388599 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-ff41ee16-f88d-45fc-a45a-43bc9a15375e req-f512ec6a-db88-49cb-8908-8cc80197c793 service nova] Creating event network-changed:095e75e8-b9ca-4c49-8292-9f9586ad794f for instance 4d699cea-9245-405e-87bb-0c9e6af9391b on hv-cinder-85221 Sep 01 14:06:18.399102 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-ff41ee16-f88d-45fc-a45a-43bc9a15375e req-f512ec6a-db88-49cb-8908-8cc80197c793 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073690 Sep 01 14:06:18.400736 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 376/773] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:19.114394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1e78e710-97a5-42d3-84cb-cadfb83f62a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:19.115004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1e78e710-97a5-42d3-84cb-cadfb83f62a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:19.123356 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e78e710-97a5-42d3-84cb-cadfb83f62a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:19.123854 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e78e710-97a5-42d3-84cb-cadfb83f62a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:19.124489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e78e710-97a5-42d3-84cb-cadfb83f62a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:19.125414 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e78e710-97a5-42d3-84cb-cadfb83f62a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:19.126338 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e78e710-97a5-42d3-84cb-cadfb83f62a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:19.126953 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e78e710-97a5-42d3-84cb-cadfb83f62a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:19.345573 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1e78e710-97a5-42d3-84cb-cadfb83f62a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:19.355952 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1e78e710-97a5-42d3-84cb-cadfb83f62a9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.245628 Sep 01 14:06:19.356666 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 398/774] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:19 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:19.809155 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d2209a5a-4431-4df1-ab1c-071d4563ddeb tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:19.810335 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d2209a5a-4431-4df1-ab1c-071d4563ddeb tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:19.822555 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2209a5a-4431-4df1-ab1c-071d4563ddeb tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:19.823093 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2209a5a-4431-4df1-ab1c-071d4563ddeb tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:19.823547 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2209a5a-4431-4df1-ab1c-071d4563ddeb tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:19.824294 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2209a5a-4431-4df1-ab1c-071d4563ddeb tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:19.824760 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2209a5a-4431-4df1-ab1c-071d4563ddeb tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:19.825196 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2209a5a-4431-4df1-ab1c-071d4563ddeb tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:19.874509 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-aeaacf77-2f15-49ba-995d-4590cfccb443 req-8c219446-dc82-41d2-bc0b-eab370bdf364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d699cea-9245-405e-87bb-0c9e6af9391b", "tag": "095e75e8-b9ca-4c49-8292-9f9586ad794f"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:19.904609 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-aeaacf77-2f15-49ba-995d-4590cfccb443 req-8c219446-dc82-41d2-bc0b-eab370bdf364 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:19.905116 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-aeaacf77-2f15-49ba-995d-4590cfccb443 req-8c219446-dc82-41d2-bc0b-eab370bdf364 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:19.905562 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-aeaacf77-2f15-49ba-995d-4590cfccb443 req-8c219446-dc82-41d2-bc0b-eab370bdf364 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:19.926428 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-aeaacf77-2f15-49ba-995d-4590cfccb443 req-8c219446-dc82-41d2-bc0b-eab370bdf364 service nova] Creating event network-changed:095e75e8-b9ca-4c49-8292-9f9586ad794f for instance 4d699cea-9245-405e-87bb-0c9e6af9391b on hv-cinder-85221 Sep 01 14:06:19.939355 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-aeaacf77-2f15-49ba-995d-4590cfccb443 req-8c219446-dc82-41d2-bc0b-eab370bdf364 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138211 Sep 01 14:06:19.943150 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 399/775] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:19.962265 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-d2209a5a-4431-4df1-ab1c-071d4563ddeb tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lazy-loading 'services' on Instance uuid 4d699cea-9245-405e-87bb-0c9e6af9391b {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:06:19.995110 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-72a8a4c0-283f-4c6e-bd8c-68b1981e5388 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "585f3190-d655-4800-a94d-ead46d34b9c5"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:19.999658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-72a8a4c0-283f-4c6e-bd8c-68b1981e5388 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:20.011965 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-72a8a4c0-283f-4c6e-bd8c-68b1981e5388 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:20.012856 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-72a8a4c0-283f-4c6e-bd8c-68b1981e5388 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:20.013651 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-72a8a4c0-283f-4c6e-bd8c-68b1981e5388 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:20.014980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-72a8a4c0-283f-4c6e-bd8c-68b1981e5388 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:20.015888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-72a8a4c0-283f-4c6e-bd8c-68b1981e5388 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:20.016588 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-72a8a4c0-283f-4c6e-bd8c-68b1981e5388 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:20.116780 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-72a8a4c0-283f-4c6e-bd8c-68b1981e5388 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Invalid volume: volume 585f3190-d655-4800-a94d-ead46d34b9c5 is already attached to instances: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-72a8a4c0-283f-4c6e-bd8c-68b1981e5388 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: POST /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments HTTP/1.1 Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 74 Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:06:20.118503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:06:20.120888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:06:20.120888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:06:20.120888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:06:20.120888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:06:20.120888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:06:20.120888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:06:20.120888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:06:20.120888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:06:20.120888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:06:20.120888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Sep 01 14:06:20.120888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {"volumeAttachment": {"volumeId": "585f3190-d655-4800-a94d-ead46d34b9c5"}} Sep 01 14:06:20.120888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Invalid volume: volume 585f3190-d655-4800-a94d-ead46d34b9c5 is already attached to instances: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'server_id': '38f7ccdd-5ecd-4809-b3e7-8ae4295552e9', 'body': {'volumeAttachment': {'volumeId': '585f3190-d655-4800-a94d-ead46d34b9c5'}}} Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 585f3190-d655-4800-a94d-ead46d34b9c5 is already attached to instances: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:20.122205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 585f3190-d655-4800-a94d-ead46d34b9c5 is already attached to instances: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:20.124537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:06:20.127755 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:06:20.127755 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:06:20.127755 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:06:20.127755 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 585f3190-d655-4800-a94d-ead46d34b9c5 is already attached to instances: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 Sep 01 14:06:20.127755 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:20.127755 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-72a8a4c0-283f-4c6e-bd8c-68b1981e5388 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 400 to user: Invalid volume: volume 585f3190-d655-4800-a94d-ead46d34b9c5 is already attached to instances: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:06:20.127755 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-72a8a4c0-283f-4c6e-bd8c-68b1981e5388 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "POST /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.136514 Sep 01 14:06:20.127755 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 400/776] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:06:19 2022] POST /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments => generated 174 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:06:20.196553 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7e3f8f02-c719-4632-b525-d7d96b8b4709 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:20.197049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7e3f8f02-c719-4632-b525-d7d96b8b4709 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:20.203276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7e3f8f02-c719-4632-b525-d7d96b8b4709 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:20.203768 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7e3f8f02-c719-4632-b525-d7d96b8b4709 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:20.204292 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7e3f8f02-c719-4632-b525-d7d96b8b4709 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:20.205225 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7e3f8f02-c719-4632-b525-d7d96b8b4709 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:20.205681 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7e3f8f02-c719-4632-b525-d7d96b8b4709 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:20.206320 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7e3f8f02-c719-4632-b525-d7d96b8b4709 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:20.210077 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d2209a5a-4431-4df1-ab1c-071d4563ddeb tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments/490d8f23-76b5-4430-a262-935c6cd56c3c" status: 202 len: 0 microversion: 2.1 time: 0.412339 Sep 01 14:06:20.213806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 377/777] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 1 14:06:19 2022] DELETE /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments/490d8f23-76b5-4430-a262-935c6cd56c3c => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:06:20.230810 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-45c44e63-5579-4483-b897-41a9d370b212 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:20.233201 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-45c44e63-5579-4483-b897-41a9d370b212 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:20.240436 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-45c44e63-5579-4483-b897-41a9d370b212 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:20.242663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-45c44e63-5579-4483-b897-41a9d370b212 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:20.242663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-45c44e63-5579-4483-b897-41a9d370b212 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:20.242663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-45c44e63-5579-4483-b897-41a9d370b212 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:20.242663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-45c44e63-5579-4483-b897-41a9d370b212 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:20.243313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-45c44e63-5579-4483-b897-41a9d370b212 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:20.287809 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-45c44e63-5579-4483-b897-41a9d370b212 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062093 Sep 01 14:06:20.293471 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 378/778] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:06:20 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:20.327971 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-7e3f8f02-c719-4632-b525-d7d96b8b4709 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lazy-loading 'services' on Instance uuid 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:06:20.385152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ad85d468-df3e-4343-a7f4-07c68b7d8aee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:20.399119 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ad85d468-df3e-4343-a7f4-07c68b7d8aee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:20.414163 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ad85d468-df3e-4343-a7f4-07c68b7d8aee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:20.414163 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ad85d468-df3e-4343-a7f4-07c68b7d8aee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:20.414163 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ad85d468-df3e-4343-a7f4-07c68b7d8aee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:20.414665 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ad85d468-df3e-4343-a7f4-07c68b7d8aee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:20.415564 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ad85d468-df3e-4343-a7f4-07c68b7d8aee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:20.416356 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ad85d468-df3e-4343-a7f4-07c68b7d8aee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:20.574835 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7e3f8f02-c719-4632-b525-d7d96b8b4709 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments/585f3190-d655-4800-a94d-ead46d34b9c5" status: 202 len: 0 microversion: 2.1 time: 0.381808 Sep 01 14:06:20.576271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 401/779] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 1 14:06:20 2022] DELETE /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments/585f3190-d655-4800-a94d-ead46d34b9c5 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:06:20.589693 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-75e4359e-6079-42c3-ae64-243314b0d74f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:20.594184 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-75e4359e-6079-42c3-ae64-243314b0d74f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:20.606142 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-75e4359e-6079-42c3-ae64-243314b0d74f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:20.607367 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-75e4359e-6079-42c3-ae64-243314b0d74f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:20.608400 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-75e4359e-6079-42c3-ae64-243314b0d74f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:20.609937 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-75e4359e-6079-42c3-ae64-243314b0d74f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:20.611056 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-75e4359e-6079-42c3-ae64-243314b0d74f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:20.612065 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-75e4359e-6079-42c3-ae64-243314b0d74f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:20.676352 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-75e4359e-6079-42c3-ae64-243314b0d74f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094064 Sep 01 14:06:20.676848 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 402/780] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:06:20 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:20.682127 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ad85d468-df3e-4343-a7f4-07c68b7d8aee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:20.692670 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ad85d468-df3e-4343-a7f4-07c68b7d8aee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.314761 Sep 01 14:06:20.693431 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 379/781] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:20 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:21.300785 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c7c4b9e2-c747-4009-ad5e-085d7001ccdf tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:21.302959 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c7c4b9e2-c747-4009-ad5e-085d7001ccdf tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:21.310564 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c7c4b9e2-c747-4009-ad5e-085d7001ccdf tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:21.311077 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c7c4b9e2-c747-4009-ad5e-085d7001ccdf tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:21.311510 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c7c4b9e2-c747-4009-ad5e-085d7001ccdf tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:21.312227 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c7c4b9e2-c747-4009-ad5e-085d7001ccdf tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:21.312674 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c7c4b9e2-c747-4009-ad5e-085d7001ccdf tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:21.313092 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c7c4b9e2-c747-4009-ad5e-085d7001ccdf tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:21.347493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c7c4b9e2-c747-4009-ad5e-085d7001ccdf tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050785 Sep 01 14:06:21.348085 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 403/782] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:06:21 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:21.688996 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4a75336c-25ee-4335-9bbd-ce2a68610c06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:21.691501 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4a75336c-25ee-4335-9bbd-ce2a68610c06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:21.699027 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4a75336c-25ee-4335-9bbd-ce2a68610c06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:21.699619 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4a75336c-25ee-4335-9bbd-ce2a68610c06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:21.700127 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4a75336c-25ee-4335-9bbd-ce2a68610c06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:21.700839 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4a75336c-25ee-4335-9bbd-ce2a68610c06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:21.701293 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4a75336c-25ee-4335-9bbd-ce2a68610c06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:21.701717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4a75336c-25ee-4335-9bbd-ce2a68610c06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:21.718245 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-fb4e6fad-dffb-46e3-a57b-64cafe93e041 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:21.719128 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-fb4e6fad-dffb-46e3-a57b-64cafe93e041 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:21.727447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fb4e6fad-dffb-46e3-a57b-64cafe93e041 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:21.728045 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fb4e6fad-dffb-46e3-a57b-64cafe93e041 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:21.728520 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fb4e6fad-dffb-46e3-a57b-64cafe93e041 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:21.729277 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fb4e6fad-dffb-46e3-a57b-64cafe93e041 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:21.729745 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fb4e6fad-dffb-46e3-a57b-64cafe93e041 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:21.730203 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fb4e6fad-dffb-46e3-a57b-64cafe93e041 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:21.734313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4a75336c-25ee-4335-9bbd-ce2a68610c06 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049371 Sep 01 14:06:21.734910 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 380/783] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:06:21 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:21.872617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fb4e6fad-dffb-46e3-a57b-64cafe93e041 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:21.881394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-fb4e6fad-dffb-46e3-a57b-64cafe93e041 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1735 microversion: 2.1 time: 0.168413 Sep 01 14:06:21.881997 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 404/784] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:21 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:22.363977 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5b47cb78-0eaf-41de-88be-74df1f4f88c8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:22.367446 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5b47cb78-0eaf-41de-88be-74df1f4f88c8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:22.379446 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b47cb78-0eaf-41de-88be-74df1f4f88c8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:22.380003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b47cb78-0eaf-41de-88be-74df1f4f88c8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:22.380766 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b47cb78-0eaf-41de-88be-74df1f4f88c8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:22.382046 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b47cb78-0eaf-41de-88be-74df1f4f88c8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:22.382801 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b47cb78-0eaf-41de-88be-74df1f4f88c8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:22.383326 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b47cb78-0eaf-41de-88be-74df1f4f88c8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:22.424401 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5b47cb78-0eaf-41de-88be-74df1f4f88c8 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067000 Sep 01 14:06:22.425009 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 381/785] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:06:22 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:22.747354 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-099bcbb7-642a-48f1-8f11-bfbc15b54303 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:22.749723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-099bcbb7-642a-48f1-8f11-bfbc15b54303 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:22.756773 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099bcbb7-642a-48f1-8f11-bfbc15b54303 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:22.757269 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099bcbb7-642a-48f1-8f11-bfbc15b54303 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:22.757720 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099bcbb7-642a-48f1-8f11-bfbc15b54303 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:22.759035 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099bcbb7-642a-48f1-8f11-bfbc15b54303 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:22.759035 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099bcbb7-642a-48f1-8f11-bfbc15b54303 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:22.764630 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-099bcbb7-642a-48f1-8f11-bfbc15b54303 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:22.791497 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-099bcbb7-642a-48f1-8f11-bfbc15b54303 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048872 Sep 01 14:06:22.792090 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 405/786] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:06:22 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:22.903370 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-eb302f4d-db2c-42ec-87d4-59f0065a16ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:22.903921 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-eb302f4d-db2c-42ec-87d4-59f0065a16ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:22.906323 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=72 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:22.911948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eb302f4d-db2c-42ec-87d4-59f0065a16ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:22.912212 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eb302f4d-db2c-42ec-87d4-59f0065a16ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:22.912520 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eb302f4d-db2c-42ec-87d4-59f0065a16ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:22.913200 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eb302f4d-db2c-42ec-87d4-59f0065a16ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:22.913660 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eb302f4d-db2c-42ec-87d4-59f0065a16ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:22.914222 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-eb302f4d-db2c-42ec-87d4-59f0065a16ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.048858 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-eb302f4d-db2c-42ec-87d4-59f0065a16ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:23.057646 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-eb302f4d-db2c-42ec-87d4-59f0065a16ee tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1715 microversion: 2.1 time: 0.158192 Sep 01 14:06:23.058261 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 382/787] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:22 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:23.180747 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d5b4691b-579a-4649-a396-a266e316aa13 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:23.182252 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d5b4691b-579a-4649-a396-a266e316aa13 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:23.187965 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5b4691b-579a-4649-a396-a266e316aa13 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.188467 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5b4691b-579a-4649-a396-a266e316aa13 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.188964 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5b4691b-579a-4649-a396-a266e316aa13 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.189701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5b4691b-579a-4649-a396-a266e316aa13 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.190258 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5b4691b-579a-4649-a396-a266e316aa13 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.190751 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5b4691b-579a-4649-a396-a266e316aa13 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.285066 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-d5b4691b-579a-4649-a396-a266e316aa13 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] HTTP exception thrown: Cannot 'detach_volume' instance 901d0282-c949-4f4d-9f04-7141c3b42480 while it is in vm_state rescued Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d5b4691b-579a-4649-a396-a266e316aa13 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Request method failure captured: Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: DELETE /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-volume_attachments/402293c6-238b-4b8c-86ac-ac2402ded0c6 HTTP/1.1 Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELtodHK0hlU0ssq5VsVzMh6Isxe-uCStXQYmXx3WC5v-cWde1ZtUEz4tBUd99Izqseob2wB5HoMDtngWz9-8nQFIx5OnaExar3GImRdIpuyNt3odGrByyBSZ4Yaf1qZx3OBIwh6RmJIDNKvWbLt58dvpxlaGOkEb_1yXcgptrN7a0EY Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: dce10589b8b240e6829f2e158415a1b8 Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:06:23.286757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:06:23.288099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dce10589b8b240e6829f2e158415a1b8"}]}] Sep 01 14:06:23.288099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:06:23.288099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: dce10589b8b240e6829f2e158415a1b8 Sep 01 14:06:23.288099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:06:23.288099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-ServerRescueNegativeTestJSON-1978503690-project Sep 01 14:06:23.288099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:06:23.288099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:06:23.288099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 65c88d8b86544ab5825adbadb26b1e2e Sep 01 14:06:23.288099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1978503690-project Sep 01 14:06:23.288099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:06:23.288099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Cannot 'detach_volume' instance 901d0282-c949-4f4d-9f04-7141c3b42480 while it is in vm_state rescued Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'server_id': '901d0282-c949-4f4d-9f04-7141c3b42480', 'id': '402293c6-238b-4b8c-86ac-ac2402ded0c6'} Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 901d0282-c949-4f4d-9f04-7141c3b42480 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:06:23.288841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 901d0282-c949-4f4d-9f04-7141c3b42480 while it is in vm_state rescued Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 901d0282-c949-4f4d-9f04-7141c3b42480 while it is in vm_state rescued Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:23.290383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d5b4691b-579a-4649-a396-a266e316aa13 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Returning 409 to user: Cannot 'detach_volume' instance 901d0282-c949-4f4d-9f04-7141c3b42480 while it is in vm_state rescued {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:06:23.291514 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d5b4691b-579a-4649-a396-a266e316aa13 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "DELETE /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-volume_attachments/402293c6-238b-4b8c-86ac-ac2402ded0c6" status: 409 len: 152 microversion: 2.1 time: 0.112912 Sep 01 14:06:23.291514 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 406/788] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 1 14:06:23 2022] DELETE /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-volume_attachments/402293c6-238b-4b8c-86ac-ac2402ded0c6 => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 14:06:23.297660 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ddfe25e3-c264-498b-b330-e247cbbf2652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:23.298217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ddfe25e3-c264-498b-b330-e247cbbf2652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:23.305172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ddfe25e3-c264-498b-b330-e247cbbf2652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.310455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ddfe25e3-c264-498b-b330-e247cbbf2652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.310455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ddfe25e3-c264-498b-b330-e247cbbf2652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.310455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ddfe25e3-c264-498b-b330-e247cbbf2652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.310455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ddfe25e3-c264-498b-b330-e247cbbf2652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.310868 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ddfe25e3-c264-498b-b330-e247cbbf2652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.437879 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ce273a9f-e555-46f2-9126-30d894e17031 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:23.440003 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ce273a9f-e555-46f2-9126-30d894e17031 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:23.446881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce273a9f-e555-46f2-9126-30d894e17031 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.447357 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce273a9f-e555-46f2-9126-30d894e17031 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.447788 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce273a9f-e555-46f2-9126-30d894e17031 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.448481 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce273a9f-e555-46f2-9126-30d894e17031 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.448925 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce273a9f-e555-46f2-9126-30d894e17031 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.449343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce273a9f-e555-46f2-9126-30d894e17031 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.481595 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ce273a9f-e555-46f2-9126-30d894e17031 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048311 Sep 01 14:06:23.482181 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 407/789] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:06:23 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:23.519101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ddfe25e3-c264-498b-b330-e247cbbf2652 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "POST /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/action" status: 202 len: 0 microversion: 2.1 time: 0.225189 Sep 01 14:06:23.519756 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 383/790] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:06:23 2022] POST /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:06:23.529269 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c91dd8e8-eb47-48f6-9bf9-b89f9afe4336 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:23.529997 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c91dd8e8-eb47-48f6-9bf9-b89f9afe4336 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:23.536306 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c91dd8e8-eb47-48f6-9bf9-b89f9afe4336 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.536792 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c91dd8e8-eb47-48f6-9bf9-b89f9afe4336 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.537234 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c91dd8e8-eb47-48f6-9bf9-b89f9afe4336 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.537980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c91dd8e8-eb47-48f6-9bf9-b89f9afe4336 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.538442 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c91dd8e8-eb47-48f6-9bf9-b89f9afe4336 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.538867 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c91dd8e8-eb47-48f6-9bf9-b89f9afe4336 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.764829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c91dd8e8-eb47-48f6-9bf9-b89f9afe4336 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:23.773987 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c91dd8e8-eb47-48f6-9bf9-b89f9afe4336 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1723 microversion: 2.1 time: 0.248674 Sep 01 14:06:23.775064 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 408/791] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:23 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:23.805552 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5e8604e1-76ff-44e7-ae34-3c49db2dff7e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:23.808011 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5e8604e1-76ff-44e7-ae34-3c49db2dff7e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:23.814663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5e8604e1-76ff-44e7-ae34-3c49db2dff7e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.815149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5e8604e1-76ff-44e7-ae34-3c49db2dff7e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.815584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5e8604e1-76ff-44e7-ae34-3c49db2dff7e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.816312 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5e8604e1-76ff-44e7-ae34-3c49db2dff7e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:23.816958 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5e8604e1-76ff-44e7-ae34-3c49db2dff7e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:23.817378 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5e8604e1-76ff-44e7-ae34-3c49db2dff7e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:23.850800 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5e8604e1-76ff-44e7-ae34-3c49db2dff7e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050088 Sep 01 14:06:23.851772 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 384/792] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:06:23 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:24.499324 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-092a7dde-8a7a-4f96-a05c-96301c330b73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:24.501976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-092a7dde-8a7a-4f96-a05c-96301c330b73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:24.508333 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-092a7dde-8a7a-4f96-a05c-96301c330b73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.508807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-092a7dde-8a7a-4f96-a05c-96301c330b73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.509252 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-092a7dde-8a7a-4f96-a05c-96301c330b73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.510016 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-092a7dde-8a7a-4f96-a05c-96301c330b73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.510475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-092a7dde-8a7a-4f96-a05c-96301c330b73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.512111 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-092a7dde-8a7a-4f96-a05c-96301c330b73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.514282 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:24.545170 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-092a7dde-8a7a-4f96-a05c-96301c330b73 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051944 Sep 01 14:06:24.545752 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 409/793] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:06:24 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:06:24.556433 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d2e51429-194b-4c7d-92d7-6f32348f1ace tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:24.556975 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d2e51429-194b-4c7d-92d7-6f32348f1ace tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:24.564276 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2e51429-194b-4c7d-92d7-6f32348f1ace tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.564800 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2e51429-194b-4c7d-92d7-6f32348f1ace tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.565242 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2e51429-194b-4c7d-92d7-6f32348f1ace tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.565993 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2e51429-194b-4c7d-92d7-6f32348f1ace tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.566456 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2e51429-194b-4c7d-92d7-6f32348f1ace tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.566938 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2e51429-194b-4c7d-92d7-6f32348f1ace tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.647372 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-d2e51429-194b-4c7d-92d7-6f32348f1ace tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] HTTP exception thrown: Instance 4d699cea-9245-405e-87bb-0c9e6af9391b is not attached to volume 490d8f23-76b5-4430-a262-935c6cd56c3c Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d2e51429-194b-4c7d-92d7-6f32348f1ace tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Request method failure captured: Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: DELETE /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments/490d8f23-76b5-4430-a262-935c6cd56c3c HTTP/1.1 Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELuTLQeYJfHzaMcNV1X3VzRWQY5CbDYUQwO9EF4Unb8CS4o7jw5b69dHobQxAqrLaxVpX9OKNTysVvbGE8TSzfQV1osM71ggTZ2X3BphX7ryJ9YTx3A7ig4Wn1tLIgIK7CAtqAb_sT4PuEThvH1kEuPN3NdW4X3meuE5Z303-Z7gg84 Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: a9e92afcc6744da393978638b5b986a5 Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-TestMinimumBasicScenario-1996373925 Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:06:24.666543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:06:24.668438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9e92afcc6744da393978638b5b986a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a9e92afcc6744da393978638b5b986a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9e92afcc6744da393978638b5b986a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a9e92afcc6744da393978638b5b986a5"}]}] Sep 01 14:06:24.668438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-TestMinimumBasicScenario-1996373925 Sep 01 14:06:24.668438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: a9e92afcc6744da393978638b5b986a5 Sep 01 14:06:24.668438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1996373925 Sep 01 14:06:24.668438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-TestMinimumBasicScenario-1996373925-project Sep 01 14:06:24.668438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:06:24.668438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:06:24.668438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 026b4316e9fb4f78ae1e9c7c3fa6c201 Sep 01 14:06:24.668438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-TestMinimumBasicScenario-1996373925-project Sep 01 14:06:24.668438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:06:24.668438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 4d699cea-9245-405e-87bb-0c9e6af9391b is not attached to volume 490d8f23-76b5-4430-a262-935c6cd56c3c Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'server_id': '4d699cea-9245-405e-87bb-0c9e6af9391b', 'id': '490d8f23-76b5-4430-a262-935c6cd56c3c'} Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 490d8f23-76b5-4430-a262-935c6cd56c3c. Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:06:24.669259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d699cea-9245-405e-87bb-0c9e6af9391b is not attached to volume 490d8f23-76b5-4430-a262-935c6cd56c3c Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d699cea-9245-405e-87bb-0c9e6af9391b is not attached to volume 490d8f23-76b5-4430-a262-935c6cd56c3c Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:06:24.670971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d2e51429-194b-4c7d-92d7-6f32348f1ace tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Returning 404 to user: Instance 4d699cea-9245-405e-87bb-0c9e6af9391b is not attached to volume 490d8f23-76b5-4430-a262-935c6cd56c3c {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:06:24.672413 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d2e51429-194b-4c7d-92d7-6f32348f1ace tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments/490d8f23-76b5-4430-a262-935c6cd56c3c" status: 404 len: 154 microversion: 2.1 time: 0.115937 Sep 01 14:06:24.672413 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 385/794] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 1 14:06:24 2022] DELETE /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b/os-volume_attachments/490d8f23-76b5-4430-a262-935c6cd56c3c => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:06:24.796242 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-46b3381c-b989-4a8c-ad9f-e7fc414e7e1d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:24.796856 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-46b3381c-b989-4a8c-ad9f-e7fc414e7e1d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:24.799512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=80 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:24.805521 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-46b3381c-b989-4a8c-ad9f-e7fc414e7e1d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.806044 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-46b3381c-b989-4a8c-ad9f-e7fc414e7e1d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.806487 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-46b3381c-b989-4a8c-ad9f-e7fc414e7e1d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.807198 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-46b3381c-b989-4a8c-ad9f-e7fc414e7e1d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.807664 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-46b3381c-b989-4a8c-ad9f-e7fc414e7e1d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.808094 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-46b3381c-b989-4a8c-ad9f-e7fc414e7e1d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.863120 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0cc6b3e0-982b-43b0-8557-a13a17925661 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:24.865411 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0cc6b3e0-982b-43b0-8557-a13a17925661 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:24.871990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cc6b3e0-982b-43b0-8557-a13a17925661 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.872592 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cc6b3e0-982b-43b0-8557-a13a17925661 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.873096 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cc6b3e0-982b-43b0-8557-a13a17925661 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.873922 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cc6b3e0-982b-43b0-8557-a13a17925661 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.874449 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cc6b3e0-982b-43b0-8557-a13a17925661 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.874946 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0cc6b3e0-982b-43b0-8557-a13a17925661 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.909077 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0cc6b3e0-982b-43b0-8557-a13a17925661 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049889 Sep 01 14:06:24.912926 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 386/795] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:06:24 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 14:06:24.970302 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-46b3381c-b989-4a8c-ad9f-e7fc414e7e1d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:24.979165 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-46b3381c-b989-4a8c-ad9f-e7fc414e7e1d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1723 microversion: 2.1 time: 0.186733 Sep 01 14:06:24.987965 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9cf078aa-f0a5-4be7-8ff7-de5a0f376f22 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:24.988558 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9cf078aa-f0a5-4be7-8ff7-de5a0f376f22 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:24.991037 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 410/796] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:24 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:24.995599 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cf078aa-f0a5-4be7-8ff7-de5a0f376f22 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.996424 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cf078aa-f0a5-4be7-8ff7-de5a0f376f22 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.997081 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cf078aa-f0a5-4be7-8ff7-de5a0f376f22 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:24.998059 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cf078aa-f0a5-4be7-8ff7-de5a0f376f22 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:24.998890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cf078aa-f0a5-4be7-8ff7-de5a0f376f22 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:24.999663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cf078aa-f0a5-4be7-8ff7-de5a0f376f22 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:25.029485 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9cf078aa-f0a5-4be7-8ff7-de5a0f376f22 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Going to try to terminate instance {{(pid=127812) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:06:25.156897 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:25.390015 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9cf078aa-f0a5-4be7-8ff7-de5a0f376f22 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 204 len: 0 microversion: 2.1 time: 0.405682 Sep 01 14:06:25.390612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 387/797] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:06:24 2022] DELETE /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:06:25.405272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-642c6a12-f5bd-45fa-8a1d-8b52d670fcdf tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:25.405926 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-642c6a12-f5bd-45fa-8a1d-8b52d670fcdf tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:25.413080 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-642c6a12-f5bd-45fa-8a1d-8b52d670fcdf tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:25.413486 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-642c6a12-f5bd-45fa-8a1d-8b52d670fcdf tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:25.413968 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-642c6a12-f5bd-45fa-8a1d-8b52d670fcdf tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:25.414738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-642c6a12-f5bd-45fa-8a1d-8b52d670fcdf tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:25.415203 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-642c6a12-f5bd-45fa-8a1d-8b52d670fcdf tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:25.415725 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-642c6a12-f5bd-45fa-8a1d-8b52d670fcdf tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:25.560196 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-642c6a12-f5bd-45fa-8a1d-8b52d670fcdf tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:25.568854 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-642c6a12-f5bd-45fa-8a1d-8b52d670fcdf tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1683 microversion: 2.1 time: 0.167554 Sep 01 14:06:25.569446 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 411/798] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:25 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:26.004134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f4cbb54b-d886-4da8-a830-9a322a38e432 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:26.004833 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f4cbb54b-d886-4da8-a830-9a322a38e432 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:26.011882 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f4cbb54b-d886-4da8-a830-9a322a38e432 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:26.012379 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f4cbb54b-d886-4da8-a830-9a322a38e432 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:26.012822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f4cbb54b-d886-4da8-a830-9a322a38e432 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:26.013531 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f4cbb54b-d886-4da8-a830-9a322a38e432 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:26.014030 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f4cbb54b-d886-4da8-a830-9a322a38e432 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:26.014463 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f4cbb54b-d886-4da8-a830-9a322a38e432 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:26.048533 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-21d5db81-9755-4fd4-b562-4c0a93c50cb0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:26.049115 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-21d5db81-9755-4fd4-b562-4c0a93c50cb0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:26.056181 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-21d5db81-9755-4fd4-b562-4c0a93c50cb0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:26.056677 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-21d5db81-9755-4fd4-b562-4c0a93c50cb0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:26.057119 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-21d5db81-9755-4fd4-b562-4c0a93c50cb0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:26.057862 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-21d5db81-9755-4fd4-b562-4c0a93c50cb0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:26.058328 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-21d5db81-9755-4fd4-b562-4c0a93c50cb0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:26.058757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-21d5db81-9755-4fd4-b562-4c0a93c50cb0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:26.088184 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-21d5db81-9755-4fd4-b562-4c0a93c50cb0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Going to try to terminate instance {{(pid=127811) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:06:26.160563 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f4cbb54b-d886-4da8-a830-9a322a38e432 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:26.171535 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f4cbb54b-d886-4da8-a830-9a322a38e432 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1723 microversion: 2.1 time: 0.172314 Sep 01 14:06:26.172131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 388/799] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:25 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:26.372800 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-21d5db81-9755-4fd4-b562-4c0a93c50cb0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 204 len: 0 microversion: 2.1 time: 0.328173 Sep 01 14:06:26.373395 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 412/800] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:06:26 2022] DELETE /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:06:26.381817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-94fb8f83-7e40-4924-8e0c-8b7dae50a56c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:26.382427 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-94fb8f83-7e40-4924-8e0c-8b7dae50a56c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:26.388557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-94fb8f83-7e40-4924-8e0c-8b7dae50a56c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:26.389037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-94fb8f83-7e40-4924-8e0c-8b7dae50a56c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:26.389475 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-94fb8f83-7e40-4924-8e0c-8b7dae50a56c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:26.390205 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-94fb8f83-7e40-4924-8e0c-8b7dae50a56c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:26.390657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-94fb8f83-7e40-4924-8e0c-8b7dae50a56c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:26.391080 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-94fb8f83-7e40-4924-8e0c-8b7dae50a56c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:26.543154 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-94fb8f83-7e40-4924-8e0c-8b7dae50a56c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:26.554413 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-94fb8f83-7e40-4924-8e0c-8b7dae50a56c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1554 microversion: 2.1 time: 0.176277 Sep 01 14:06:26.555688 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 389/801] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:26 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:26.594740 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-00ba3ffd-b7f6-46d2-9220-7a878cb030d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:26.595451 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-00ba3ffd-b7f6-46d2-9220-7a878cb030d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:26.602159 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-00ba3ffd-b7f6-46d2-9220-7a878cb030d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:26.602654 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-00ba3ffd-b7f6-46d2-9220-7a878cb030d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:26.606373 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-00ba3ffd-b7f6-46d2-9220-7a878cb030d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:26.606373 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-00ba3ffd-b7f6-46d2-9220-7a878cb030d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:26.606373 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-00ba3ffd-b7f6-46d2-9220-7a878cb030d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:26.606373 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-00ba3ffd-b7f6-46d2-9220-7a878cb030d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:26.739694 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-00ba3ffd-b7f6-46d2-9220-7a878cb030d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:26.747689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-00ba3ffd-b7f6-46d2-9220-7a878cb030d7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1683 microversion: 2.1 time: 0.157476 Sep 01 14:06:26.748273 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 413/802] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:26 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:27.194347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0c05177c-0501-4031-bd72-3f241a9f9fdf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:27.195004 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0c05177c-0501-4031-bd72-3f241a9f9fdf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:27.202336 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0c05177c-0501-4031-bd72-3f241a9f9fdf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:27.202827 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0c05177c-0501-4031-bd72-3f241a9f9fdf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:27.203269 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0c05177c-0501-4031-bd72-3f241a9f9fdf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:27.204030 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0c05177c-0501-4031-bd72-3f241a9f9fdf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:27.204493 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0c05177c-0501-4031-bd72-3f241a9f9fdf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:27.204923 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0c05177c-0501-4031-bd72-3f241a9f9fdf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:27.341271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0c05177c-0501-4031-bd72-3f241a9f9fdf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:27.351112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0c05177c-0501-4031-bd72-3f241a9f9fdf tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1723 microversion: 2.1 time: 0.160748 Sep 01 14:06:27.351674 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 390/803] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:27 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:27.577249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-495fb42e-3f78-44f2-b787-237dabcf4d88 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:27.577846 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-495fb42e-3f78-44f2-b787-237dabcf4d88 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:27.584179 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-495fb42e-3f78-44f2-b787-237dabcf4d88 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:27.584643 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-495fb42e-3f78-44f2-b787-237dabcf4d88 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:27.585074 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-495fb42e-3f78-44f2-b787-237dabcf4d88 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:27.585786 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-495fb42e-3f78-44f2-b787-237dabcf4d88 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:27.586255 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-495fb42e-3f78-44f2-b787-237dabcf4d88 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:27.586672 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-495fb42e-3f78-44f2-b787-237dabcf4d88 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:27.717873 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-495fb42e-3f78-44f2-b787-237dabcf4d88 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:27.725682 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-495fb42e-3f78-44f2-b787-237dabcf4d88 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1554 microversion: 2.1 time: 0.152372 Sep 01 14:06:27.726274 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 414/804] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:27 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:27.769891 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1148dcfa-a7bf-4167-a5c8-8e69300a89f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:27.770494 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1148dcfa-a7bf-4167-a5c8-8e69300a89f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:27.776261 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1148dcfa-a7bf-4167-a5c8-8e69300a89f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:27.776741 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1148dcfa-a7bf-4167-a5c8-8e69300a89f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:27.777167 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1148dcfa-a7bf-4167-a5c8-8e69300a89f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:27.777885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1148dcfa-a7bf-4167-a5c8-8e69300a89f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:27.778329 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1148dcfa-a7bf-4167-a5c8-8e69300a89f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:27.778747 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1148dcfa-a7bf-4167-a5c8-8e69300a89f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:27.909255 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1148dcfa-a7bf-4167-a5c8-8e69300a89f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:27.918484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1148dcfa-a7bf-4167-a5c8-8e69300a89f8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1683 microversion: 2.1 time: 0.152480 Sep 01 14:06:27.930090 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 391/805] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:27 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:28.373570 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-810570db-5066-4706-8fa6-d01e7927000f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:28.374197 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-810570db-5066-4706-8fa6-d01e7927000f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:28.380405 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-810570db-5066-4706-8fa6-d01e7927000f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:28.380883 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-810570db-5066-4706-8fa6-d01e7927000f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:28.381311 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-810570db-5066-4706-8fa6-d01e7927000f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:28.382025 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-810570db-5066-4706-8fa6-d01e7927000f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:28.382471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-810570db-5066-4706-8fa6-d01e7927000f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:28.382888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-810570db-5066-4706-8fa6-d01e7927000f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:28.516865 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-810570db-5066-4706-8fa6-d01e7927000f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:28.525683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-810570db-5066-4706-8fa6-d01e7927000f tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1723 microversion: 2.1 time: 0.155971 Sep 01 14:06:28.526276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 415/806] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:28 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:28.747642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-336d5ef8-8105-4124-8a11-33f854461b50 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:28.748260 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-336d5ef8-8105-4124-8a11-33f854461b50 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:28.755023 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-336d5ef8-8105-4124-8a11-33f854461b50 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:28.755509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-336d5ef8-8105-4124-8a11-33f854461b50 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:28.755954 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-336d5ef8-8105-4124-8a11-33f854461b50 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:28.756657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-336d5ef8-8105-4124-8a11-33f854461b50 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:28.757112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-336d5ef8-8105-4124-8a11-33f854461b50 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:28.758049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-336d5ef8-8105-4124-8a11-33f854461b50 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:28.893089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-336d5ef8-8105-4124-8a11-33f854461b50 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:28.901624 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-336d5ef8-8105-4124-8a11-33f854461b50 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1554 microversion: 2.1 time: 0.157854 Sep 01 14:06:28.902217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 392/807] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:28 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1554 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:28.946848 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9b707a78-cb0b-4597-b1d8-835fcd9d5d52 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:28.947456 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9b707a78-cb0b-4597-b1d8-835fcd9d5d52 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:28.953909 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b707a78-cb0b-4597-b1d8-835fcd9d5d52 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:28.954411 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b707a78-cb0b-4597-b1d8-835fcd9d5d52 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:28.954861 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b707a78-cb0b-4597-b1d8-835fcd9d5d52 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:28.955596 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b707a78-cb0b-4597-b1d8-835fcd9d5d52 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:28.956060 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b707a78-cb0b-4597-b1d8-835fcd9d5d52 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:28.956498 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9b707a78-cb0b-4597-b1d8-835fcd9d5d52 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.092472 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9b707a78-cb0b-4597-b1d8-835fcd9d5d52 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:29.100511 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9b707a78-cb0b-4597-b1d8-835fcd9d5d52 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1683 microversion: 2.1 time: 0.158146 Sep 01 14:06:29.101093 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 416/808] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:28 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:29.547976 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-287b4e50-423f-43ee-af17-cadf32ce8bd9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:29.548577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-287b4e50-423f-43ee-af17-cadf32ce8bd9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:29.554655 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-287b4e50-423f-43ee-af17-cadf32ce8bd9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.555644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-287b4e50-423f-43ee-af17-cadf32ce8bd9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.556116 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-287b4e50-423f-43ee-af17-cadf32ce8bd9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.556788 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-287b4e50-423f-43ee-af17-cadf32ce8bd9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.557241 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-287b4e50-423f-43ee-af17-cadf32ce8bd9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.557663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-287b4e50-423f-43ee-af17-cadf32ce8bd9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.687971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-287b4e50-423f-43ee-af17-cadf32ce8bd9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:29.696543 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-287b4e50-423f-43ee-af17-cadf32ce8bd9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1729 microversion: 2.1 time: 0.152501 Sep 01 14:06:29.697132 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 393/809] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:29 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:29.717253 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f7137387-cfe7-464d-9f9f-e5ef787d47de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:29.717741 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f7137387-cfe7-464d-9f9f-e5ef787d47de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:29.723756 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f7137387-cfe7-464d-9f9f-e5ef787d47de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.724235 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f7137387-cfe7-464d-9f9f-e5ef787d47de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.724672 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f7137387-cfe7-464d-9f9f-e5ef787d47de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.725355 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f7137387-cfe7-464d-9f9f-e5ef787d47de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.725845 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f7137387-cfe7-464d-9f9f-e5ef787d47de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.726268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f7137387-cfe7-464d-9f9f-e5ef787d47de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.806498 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f7137387-cfe7-464d-9f9f-e5ef787d47de tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093064 Sep 01 14:06:29.807090 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 417/810] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 1 14:06:29 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:29.922857 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0334c1bd-aaa1-4507-a6cf-71e41c99a0ae tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:29.923508 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0334c1bd-aaa1-4507-a6cf-71e41c99a0ae tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:29.930245 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0334c1bd-aaa1-4507-a6cf-71e41c99a0ae tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.930731 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0334c1bd-aaa1-4507-a6cf-71e41c99a0ae tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.931165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0334c1bd-aaa1-4507-a6cf-71e41c99a0ae tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:29.931856 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0334c1bd-aaa1-4507-a6cf-71e41c99a0ae tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:29.932304 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0334c1bd-aaa1-4507-a6cf-71e41c99a0ae tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:29.932727 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0334c1bd-aaa1-4507-a6cf-71e41c99a0ae tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:30.122081 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-006842f4-418e-49ac-9131-7474a0f7dd97 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:30.122811 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-006842f4-418e-49ac-9131-7474a0f7dd97 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:30.129034 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-006842f4-418e-49ac-9131-7474a0f7dd97 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:30.133849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-006842f4-418e-49ac-9131-7474a0f7dd97 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:30.133849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-006842f4-418e-49ac-9131-7474a0f7dd97 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:30.133849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-006842f4-418e-49ac-9131-7474a0f7dd97 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:30.133849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-006842f4-418e-49ac-9131-7474a0f7dd97 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:30.134322 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-006842f4-418e-49ac-9131-7474a0f7dd97 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:30.167741 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0334c1bd-aaa1-4507-a6cf-71e41c99a0ae tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:30.179610 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0334c1bd-aaa1-4507-a6cf-71e41c99a0ae tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1554 microversion: 2.1 time: 0.256593 Sep 01 14:06:30.179610 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 394/811] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:29 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1554 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:30.616557 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-006842f4-418e-49ac-9131-7474a0f7dd97 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:30.626381 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-006842f4-418e-49ac-9131-7474a0f7dd97 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1683 microversion: 2.1 time: 0.508326 Sep 01 14:06:30.627076 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 418/812] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:30 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1683 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:31.196662 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-21751856-65db-4d66-a733-3b926dc1501f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:31.197483 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-21751856-65db-4d66-a733-3b926dc1501f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:31.204275 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-21751856-65db-4d66-a733-3b926dc1501f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:31.204774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-21751856-65db-4d66-a733-3b926dc1501f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:31.206617 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-21751856-65db-4d66-a733-3b926dc1501f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:31.211171 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-0ea22897-8384-4515-a184-78ade69e2a3e req-4f5e96b3-3646-4308-ad6d-8212347deef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901d0282-c949-4f4d-9f04-7141c3b42480", "tag": "79b8068f-760a-42ca-86d8-b6f065560433"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:31.218143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-21751856-65db-4d66-a733-3b926dc1501f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:31.218638 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-21751856-65db-4d66-a733-3b926dc1501f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:31.219080 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-21751856-65db-4d66-a733-3b926dc1501f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:31.222349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-0ea22897-8384-4515-a184-78ade69e2a3e req-4f5e96b3-3646-4308-ad6d-8212347deef7 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:31.223097 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-0ea22897-8384-4515-a184-78ade69e2a3e req-4f5e96b3-3646-4308-ad6d-8212347deef7 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:31.224604 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-0ea22897-8384-4515-a184-78ade69e2a3e req-4f5e96b3-3646-4308-ad6d-8212347deef7 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:31.242491 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-0ea22897-8384-4515-a184-78ade69e2a3e req-4f5e96b3-3646-4308-ad6d-8212347deef7 service nova] Creating event network-changed:79b8068f-760a-42ca-86d8-b6f065560433 for instance 901d0282-c949-4f4d-9f04-7141c3b42480 on hv-cinder-85221 Sep 01 14:06:31.247778 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-0ea22897-8384-4515-a184-78ade69e2a3e req-4f5e96b3-3646-4308-ad6d-8212347deef7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040661 Sep 01 14:06:31.248498 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 419/813] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:31.358767 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-21751856-65db-4d66-a733-3b926dc1501f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:31.366511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-21751856-65db-4d66-a733-3b926dc1501f tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1554 microversion: 2.1 time: 0.173741 Sep 01 14:06:31.367098 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 395/814] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:31 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:31.648116 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2b7e33ee-2e35-4f98-9e01-b8b430572057 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:31.649355 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2b7e33ee-2e35-4f98-9e01-b8b430572057 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:31.655505 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b7e33ee-2e35-4f98-9e01-b8b430572057 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:31.655991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b7e33ee-2e35-4f98-9e01-b8b430572057 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:31.656429 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b7e33ee-2e35-4f98-9e01-b8b430572057 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:31.657125 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b7e33ee-2e35-4f98-9e01-b8b430572057 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:31.657588 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b7e33ee-2e35-4f98-9e01-b8b430572057 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:31.658021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2b7e33ee-2e35-4f98-9e01-b8b430572057 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:32.027376 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2b7e33ee-2e35-4f98-9e01-b8b430572057 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:32.035735 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2b7e33ee-2e35-4f98-9e01-b8b430572057 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1683 microversion: 2.1 time: 0.391893 Sep 01 14:06:32.050131 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 420/815] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:31 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1683 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:32.388200 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3503fd66-2e5d-46c5-9c0e-ecfee7146231 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:32.388794 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3503fd66-2e5d-46c5-9c0e-ecfee7146231 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:32.395220 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3503fd66-2e5d-46c5-9c0e-ecfee7146231 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:32.395710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3503fd66-2e5d-46c5-9c0e-ecfee7146231 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:32.396149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3503fd66-2e5d-46c5-9c0e-ecfee7146231 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:32.396849 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3503fd66-2e5d-46c5-9c0e-ecfee7146231 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:32.397312 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3503fd66-2e5d-46c5-9c0e-ecfee7146231 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:32.397733 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3503fd66-2e5d-46c5-9c0e-ecfee7146231 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:32.595029 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3503fd66-2e5d-46c5-9c0e-ecfee7146231 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:32.604908 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3503fd66-2e5d-46c5-9c0e-ecfee7146231 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1554 microversion: 2.1 time: 0.220518 Sep 01 14:06:32.605494 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 396/816] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:32 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1554 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:33.057023 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f26f03c9-c621-4e27-8ab2-c8baebb02304 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:33.057694 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f26f03c9-c621-4e27-8ab2-c8baebb02304 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:33.064613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f26f03c9-c621-4e27-8ab2-c8baebb02304 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:33.069526 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f26f03c9-c621-4e27-8ab2-c8baebb02304 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:33.069526 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f26f03c9-c621-4e27-8ab2-c8baebb02304 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:33.069526 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f26f03c9-c621-4e27-8ab2-c8baebb02304 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:33.069526 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f26f03c9-c621-4e27-8ab2-c8baebb02304 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:33.070483 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f26f03c9-c621-4e27-8ab2-c8baebb02304 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:33.167151 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f26f03c9-c621-4e27-8ab2-c8baebb02304 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:33.176354 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f26f03c9-c621-4e27-8ab2-c8baebb02304 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1615 microversion: 2.1 time: 0.123436 Sep 01 14:06:33.177208 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 421/817] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:33 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1615 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:33.279575 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-1a3ffbf7-7456-4f2c-887b-4c768029693d req-0b127d30-4305-4311-951a-985d1313cfd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "901d0282-c949-4f4d-9f04-7141c3b42480", "tag": "79b8068f-760a-42ca-86d8-b6f065560433"}, {"server_uuid": "4d699cea-9245-405e-87bb-0c9e6af9391b", "name": "network-vif-deleted", "tag": "095e75e8-b9ca-4c49-8292-9f9586ad794f"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:33.290014 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-1a3ffbf7-7456-4f2c-887b-4c768029693d req-0b127d30-4305-4311-951a-985d1313cfd4 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:33.290509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-1a3ffbf7-7456-4f2c-887b-4c768029693d req-0b127d30-4305-4311-951a-985d1313cfd4 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:33.290946 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-1a3ffbf7-7456-4f2c-887b-4c768029693d req-0b127d30-4305-4311-951a-985d1313cfd4 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:33.308522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-1a3ffbf7-7456-4f2c-887b-4c768029693d req-0b127d30-4305-4311-951a-985d1313cfd4 service nova] Creating event network-changed:79b8068f-760a-42ca-86d8-b6f065560433 for instance 901d0282-c949-4f4d-9f04-7141c3b42480 on hv-cinder-85221 Sep 01 14:06:33.308522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-1a3ffbf7-7456-4f2c-887b-4c768029693d req-0b127d30-4305-4311-951a-985d1313cfd4 service nova] Creating event network-vif-deleted:095e75e8-b9ca-4c49-8292-9f9586ad794f for instance 4d699cea-9245-405e-87bb-0c9e6af9391b on hv-cinder-85221 Sep 01 14:06:33.314884 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-1a3ffbf7-7456-4f2c-887b-4c768029693d req-0b127d30-4305-4311-951a-985d1313cfd4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042158 Sep 01 14:06:33.316481 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 397/818] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:33.631188 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:33.632107 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:33.639175 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:33.644810 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:33.644810 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:33.644810 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:33.644810 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:33.645312 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:33.673858 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:33.674346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:33.674770 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:33.675379 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lazy-loading 'fault' on Instance uuid 4d699cea-9245-405e-87bb-0c9e6af9391b {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:06:33.727736 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '026b4316e9fb4f78ae1e9c7c3fa6c201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e92afcc6744da393978638b5b986a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:33.735411 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f35d2443-5ba7-44c9-91d9-71375369a93c tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 200 len: 1347 microversion: 2.1 time: 0.108034 Sep 01 14:06:33.735964 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 422/819] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:33 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 1347 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:34.202977 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:34.203704 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:34.222589 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:34.223514 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:34.224242 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:34.224971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:34.227006 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:34.227006 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:34.262298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:34.263057 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:34.263652 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:34.270023 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lazy-loading 'fault' on Instance uuid 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:06:34.361961 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:34.375533 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a493ffa1-7a6f-4d15-86fa-a4bb9c76ba88 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 200 len: 1332 microversion: 2.1 time: 0.178453 Sep 01 14:06:34.379441 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 398/820] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:34 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 1332 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:34.756862 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-548e7100-5502-46d9-8e79-00167d4956f0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:34.757560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-548e7100-5502-46d9-8e79-00167d4956f0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] [instance: 4d699cea-9245-405e-87bb-0c9e6af9391b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:34.763919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-548e7100-5502-46d9-8e79-00167d4956f0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:34.764410 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-548e7100-5502-46d9-8e79-00167d4956f0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:34.764847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-548e7100-5502-46d9-8e79-00167d4956f0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:34.765551 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-548e7100-5502-46d9-8e79-00167d4956f0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:34.766132 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-548e7100-5502-46d9-8e79-00167d4956f0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:34.766704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-548e7100-5502-46d9-8e79-00167d4956f0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:34.781268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-548e7100-5502-46d9-8e79-00167d4956f0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] HTTP exception thrown: Instance 4d699cea-9245-405e-87bb-0c9e6af9391b could not be found. Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-548e7100-5502-46d9-8e79-00167d4956f0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Request method failure captured: Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b HTTP/1.1 Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELuTLQeYJfHzaMcNV1X3VzRWQY5CbDYUQwO9EF4Unb8CS4o7jw5b69dHobQxAqrLaxVpX9OKNTysVvbGE8TSzfQV1osM71ggTZ2X3BphX7ryJ9YTx3A7ig4Wn1tLIgIK7CAtqAb_sT4PuEThvH1kEuPN3NdW4X3meuE5Z303-Z7gg84 Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: a9e92afcc6744da393978638b5b986a5 Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-TestMinimumBasicScenario-1996373925 Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:06:34.782976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:06:34.784531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9e92afcc6744da393978638b5b986a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a9e92afcc6744da393978638b5b986a5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a9e92afcc6744da393978638b5b986a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a9e92afcc6744da393978638b5b986a5"}]}] Sep 01 14:06:34.784531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-TestMinimumBasicScenario-1996373925 Sep 01 14:06:34.784531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: a9e92afcc6744da393978638b5b986a5 Sep 01 14:06:34.784531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1996373925 Sep 01 14:06:34.784531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-TestMinimumBasicScenario-1996373925-project Sep 01 14:06:34.784531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:06:34.784531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:06:34.784531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 026b4316e9fb4f78ae1e9c7c3fa6c201 Sep 01 14:06:34.784531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-TestMinimumBasicScenario-1996373925-project Sep 01 14:06:34.784531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:06:34.784531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 4d699cea-9245-405e-87bb-0c9e6af9391b could not be found. Sep 01 14:06:34.784531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '4d699cea-9245-405e-87bb-0c9e6af9391b'} Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d699cea-9245-405e-87bb-0c9e6af9391b could not be found. Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:06:34.785398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d699cea-9245-405e-87bb-0c9e6af9391b could not be found. Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d699cea-9245-405e-87bb-0c9e6af9391b could not be found. Sep 01 14:06:34.786860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:06:34.788163 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-548e7100-5502-46d9-8e79-00167d4956f0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Returning 404 to user: Instance 4d699cea-9245-405e-87bb-0c9e6af9391b could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:06:34.788163 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-548e7100-5502-46d9-8e79-00167d4956f0 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b" status: 404 len: 111 microversion: 2.1 time: 0.031541 Sep 01 14:06:34.788163 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 423/821] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:34 2022] GET /compute/v2.1/servers/4d699cea-9245-405e-87bb-0c9e6af9391b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:06:34.793956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ca5f755e-d8c6-4ece-9ef2-cdc7b3a5a934 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] Calling method '.version_select at 0x7f1afd0f3ca0>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:34.887585 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ca5f755e-d8c6-4ece-9ef2-cdc7b3a5a934 tempest-TestMinimumBasicScenario-1996373925 tempest-TestMinimumBasicScenario-1996373925-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-686709729" status: 202 len: 0 microversion: 2.1 time: 0.097462 Sep 01 14:06:34.888181 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 399/822] 10.222.0.61 () {58 vars in 1269 bytes} [Thu Sep 1 14:06:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-686709729 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:06:35.332844 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-504cd6ca-e1da-4a48-bfc2-b237196822c2 req-7b769ead-d37e-4235-886c-f0339b43bd46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f7ccdd-5ecd-4809-b3e7-8ae4295552e9", "name": "network-vif-deleted", "tag": "8ead0825-a787-42d8-bd59-6407444b72c6"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:35.342838 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-504cd6ca-e1da-4a48-bfc2-b237196822c2 req-7b769ead-d37e-4235-886c-f0339b43bd46 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:35.343296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-504cd6ca-e1da-4a48-bfc2-b237196822c2 req-7b769ead-d37e-4235-886c-f0339b43bd46 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:35.343725 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-504cd6ca-e1da-4a48-bfc2-b237196822c2 req-7b769ead-d37e-4235-886c-f0339b43bd46 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:35.354901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-504cd6ca-e1da-4a48-bfc2-b237196822c2 req-7b769ead-d37e-4235-886c-f0339b43bd46 service nova] Creating event network-vif-deleted:8ead0825-a787-42d8-bd59-6407444b72c6 for instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 on hv-cinder-85221 Sep 01 14:06:35.359973 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-504cd6ca-e1da-4a48-bfc2-b237196822c2 req-7b769ead-d37e-4235-886c-f0339b43bd46 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030708 Sep 01 14:06:35.360569 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 424/823] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:35.396925 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d71b8272-5fac-4628-b4f4-22c7387a51e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:35.397528 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d71b8272-5fac-4628-b4f4-22c7387a51e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:35.404181 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d71b8272-5fac-4628-b4f4-22c7387a51e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:35.404657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d71b8272-5fac-4628-b4f4-22c7387a51e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:35.405089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d71b8272-5fac-4628-b4f4-22c7387a51e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:35.405825 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d71b8272-5fac-4628-b4f4-22c7387a51e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:35.406286 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d71b8272-5fac-4628-b4f4-22c7387a51e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:35.406711 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d71b8272-5fac-4628-b4f4-22c7387a51e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:35.420929 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-d71b8272-5fac-4628-b4f4-22c7387a51e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d71b8272-5fac-4628-b4f4-22c7387a51e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 HTTP/1.1 Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:06:35.422710 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:06:35.424298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:06:35.424298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:06:35.424298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:06:35.424298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:06:35.424298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:06:35.424298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:06:35.424298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:06:35.424298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:06:35.424298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:06:35.424298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:06:35.424298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:06:35.424298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '38f7ccdd-5ecd-4809-b3e7-8ae4295552e9'} Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:06:35.425230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:06:35.426627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:06:35.427994 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d71b8272-5fac-4628-b4f4-22c7387a51e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 404 to user: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:06:35.427994 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d71b8272-5fac-4628-b4f4-22c7387a51e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 404 len: 111 microversion: 2.1 time: 0.031582 Sep 01 14:06:35.427994 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 400/824] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:35 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:06:35.434251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-237b1281-f97e-4cab-9fd1-9bcc1d1fd5e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '.version_select at 0x7f1b00c80160>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:35.511840 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-237b1281-f97e-4cab-9fd1-9bcc1d1fd5e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1943551087" status: 202 len: 0 microversion: 2.1 time: 0.082098 Sep 01 14:06:35.512430 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 425/825] 10.222.0.61 () {58 vars in 1221 bytes} [Thu Sep 1 14:06:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1943551087 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:06:36.325006 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3ecef338-28c5-46b0-b1f4-119bcbb910ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Action: 'create', calling method: .version_select at 0x7f1afd1e6c10>, body: {"keypair": {"name": "tempest-keypair-413344916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBWO5rygPerVbvxxuarZnQ8pok93u+uO9ltyQ33Pp6QneOxOMpO5651eRN3hmTM4dYEJtZLYLT3aiyLU1Q96EiGri/3+zvK1BreA1L+MyXAT2YZ4i+kI+WLsjmB/ikb7oA=="}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:36.340432 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-3ecef338-28c5-46b0-b1f4-119bcbb910ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for project c19855b809cc43b2925dc3001284baaa. Resources: {'key_pairs'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:06:36.344582 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-3ecef338-28c5-46b0-b1f4-119bcbb910ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for user c0afa15991f14e0ca0d3701d06a89049 and project c19855b809cc43b2925dc3001284baaa. Resources: {'key_pairs'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:06:36.431153 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3ecef338-28c5-46b0-b1f4-119bcbb910ba tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.109871 Sep 01 14:06:36.437893 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 401/826] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 1 14:06:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:39.901001 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1061189473", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ad8c667-b460-46c7-93b9-306c7a679d39"}], "security_groups": [{"name": "tempest-securitygroup--614770935"}], "key_name": "tempest-keypair-413344916", "user_data": "}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:40.047736 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.network.neutron [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] validate_networks() for [('9ad8c667-b460-46c7-93b9-306c7a679d39', None, None, None, None, None)] {{(pid=127811) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:06:40.757636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Flavor limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:06:40.758096 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Image limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:06:40.758675 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Flavor pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:06:40.759094 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Image pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:06:40.759504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:06:40.768445 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:40.768930 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:40.769600 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:40.770390 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:40.770848 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:40.771266 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:40.789871 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for project c19855b809cc43b2925dc3001284baaa. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:06:40.794242 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Getting quotas for user c0afa15991f14e0ca0d3701d06a89049 and project c19855b809cc43b2925dc3001284baaa. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:06:40.806410 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Going to run 1 instances... {{(pid=127811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:06:40.808822 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:06:40.913404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ce5572b8-c95e-428b-b755-1a8a4c0d82a4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.017430 Sep 01 14:06:40.921424 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 426/827] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:06:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:06:40.926264 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-48889421-24d0-405d-b1f0-9a0019681788 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:40.927436 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-48889421-24d0-405d-b1f0-9a0019681788 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:41.005756 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-48889421-24d0-405d-b1f0-9a0019681788 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:41.016355 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-48889421-24d0-405d-b1f0-9a0019681788 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1241 microversion: 2.1 time: 0.094609 Sep 01 14:06:41.024775 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 402/828] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:40 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:42.038528 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f0bab0d8-ac6c-4b31-a4f6-0ba17021a5ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:42.039167 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f0bab0d8-ac6c-4b31-a4f6-0ba17021a5ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:42.047223 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f0bab0d8-ac6c-4b31-a4f6-0ba17021a5ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:42.047713 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f0bab0d8-ac6c-4b31-a4f6-0ba17021a5ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:42.048154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f0bab0d8-ac6c-4b31-a4f6-0ba17021a5ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:42.048853 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f0bab0d8-ac6c-4b31-a4f6-0ba17021a5ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:42.049307 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f0bab0d8-ac6c-4b31-a4f6-0ba17021a5ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:42.049936 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f0bab0d8-ac6c-4b31-a4f6-0ba17021a5ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:42.113155 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f0bab0d8-ac6c-4b31-a4f6-0ba17021a5ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:42.115534 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:42.122250 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f0bab0d8-ac6c-4b31-a4f6-0ba17021a5ff tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1245 microversion: 2.1 time: 0.087806 Sep 01 14:06:42.122840 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 427/829] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:42 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:43.151304 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c4fd45df-5e36-4614-9928-574ff68781a3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:43.151914 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c4fd45df-5e36-4614-9928-574ff68781a3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:43.169318 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c4fd45df-5e36-4614-9928-574ff68781a3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:43.169879 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c4fd45df-5e36-4614-9928-574ff68781a3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:43.170313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c4fd45df-5e36-4614-9928-574ff68781a3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:43.171049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c4fd45df-5e36-4614-9928-574ff68781a3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:43.171500 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c4fd45df-5e36-4614-9928-574ff68781a3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:43.171917 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c4fd45df-5e36-4614-9928-574ff68781a3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:43.246442 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c4fd45df-5e36-4614-9928-574ff68781a3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:43.258227 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c4fd45df-5e36-4614-9928-574ff68781a3 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1293 microversion: 2.1 time: 0.109663 Sep 01 14:06:43.259117 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 403/830] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:43 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:44.284198 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-fe14fe72-3908-4702-85ad-6ce1e87cd90e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:44.284815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-fe14fe72-3908-4702-85ad-6ce1e87cd90e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:44.294664 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fe14fe72-3908-4702-85ad-6ce1e87cd90e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:44.295167 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fe14fe72-3908-4702-85ad-6ce1e87cd90e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:44.295605 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fe14fe72-3908-4702-85ad-6ce1e87cd90e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:44.296334 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fe14fe72-3908-4702-85ad-6ce1e87cd90e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:44.296796 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fe14fe72-3908-4702-85ad-6ce1e87cd90e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:44.297226 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fe14fe72-3908-4702-85ad-6ce1e87cd90e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:44.487307 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fe14fe72-3908-4702-85ad-6ce1e87cd90e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:44.505792 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-fe14fe72-3908-4702-85ad-6ce1e87cd90e tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1366 microversion: 2.1 time: 0.225575 Sep 01 14:06:44.510193 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 428/831] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:44 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:45.534397 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-c900cbf3-fd4c-474d-bffc-8ed3a8b4b64f req-0c47d1d6-3efa-4161-b858-c96759e5d00c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66fe2a32-ad87-42ac-8aca-7878f7c65c0c", "tag": "552d6bb2-fe64-4e63-a029-3c894cb1f1aa"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:45.545925 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-87bcf544-b710-43a6-becc-fea06d20c2bd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:45.546555 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-87bcf544-b710-43a6-becc-fea06d20c2bd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:45.548214 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-c900cbf3-fd4c-474d-bffc-8ed3a8b4b64f req-0c47d1d6-3efa-4161-b858-c96759e5d00c service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:45.549014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-c900cbf3-fd4c-474d-bffc-8ed3a8b4b64f req-0c47d1d6-3efa-4161-b858-c96759e5d00c service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:45.549923 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-c900cbf3-fd4c-474d-bffc-8ed3a8b4b64f req-0c47d1d6-3efa-4161-b858-c96759e5d00c service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:45.556394 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-87bcf544-b710-43a6-becc-fea06d20c2bd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:45.557347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-87bcf544-b710-43a6-becc-fea06d20c2bd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:45.557810 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-87bcf544-b710-43a6-becc-fea06d20c2bd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:45.558547 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-87bcf544-b710-43a6-becc-fea06d20c2bd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:45.559005 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-87bcf544-b710-43a6-becc-fea06d20c2bd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:45.559430 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-87bcf544-b710-43a6-becc-fea06d20c2bd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:45.566322 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-c900cbf3-fd4c-474d-bffc-8ed3a8b4b64f req-0c47d1d6-3efa-4161-b858-c96759e5d00c service nova] Creating event network-changed:552d6bb2-fe64-4e63-a029-3c894cb1f1aa for instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c on hv-cinder-85221 Sep 01 14:06:45.572011 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-c900cbf3-fd4c-474d-bffc-8ed3a8b4b64f req-0c47d1d6-3efa-4161-b858-c96759e5d00c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042394 Sep 01 14:06:45.573062 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 429/832] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:45.783492 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-87bcf544-b710-43a6-becc-fea06d20c2bd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:45.792471 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-87bcf544-b710-43a6-becc-fea06d20c2bd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1366 microversion: 2.1 time: 0.264946 Sep 01 14:06:45.793287 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 404/833] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:45 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:46.813669 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-67b29902-f1fe-4f36-84a6-3aa9ecaf66ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:46.814415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-67b29902-f1fe-4f36-84a6-3aa9ecaf66ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:46.821547 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67b29902-f1fe-4f36-84a6-3aa9ecaf66ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:46.822069 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67b29902-f1fe-4f36-84a6-3aa9ecaf66ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:46.822508 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67b29902-f1fe-4f36-84a6-3aa9ecaf66ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:46.823202 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67b29902-f1fe-4f36-84a6-3aa9ecaf66ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:46.823658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67b29902-f1fe-4f36-84a6-3aa9ecaf66ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:46.824082 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67b29902-f1fe-4f36-84a6-3aa9ecaf66ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:46.978195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-67b29902-f1fe-4f36-84a6-3aa9ecaf66ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:46.986306 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-67b29902-f1fe-4f36-84a6-3aa9ecaf66ac tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1366 microversion: 2.1 time: 0.177335 Sep 01 14:06:46.995914 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 430/834] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:46 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:48.020144 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0384d998-bb38-4fbc-8d14-7291d101c07f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:48.020795 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0384d998-bb38-4fbc-8d14-7291d101c07f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:48.028216 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0384d998-bb38-4fbc-8d14-7291d101c07f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:48.028549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0384d998-bb38-4fbc-8d14-7291d101c07f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:48.028989 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0384d998-bb38-4fbc-8d14-7291d101c07f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:48.029711 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0384d998-bb38-4fbc-8d14-7291d101c07f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:48.030273 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0384d998-bb38-4fbc-8d14-7291d101c07f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:48.030701 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0384d998-bb38-4fbc-8d14-7291d101c07f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:48.240848 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3f72b4e2-9971-48e3-bbf6-c49b62f99f6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:48.241977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3f72b4e2-9971-48e3-bbf6-c49b62f99f6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:48.248909 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3f72b4e2-9971-48e3-bbf6-c49b62f99f6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:48.249518 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3f72b4e2-9971-48e3-bbf6-c49b62f99f6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:48.250063 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3f72b4e2-9971-48e3-bbf6-c49b62f99f6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:48.250840 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3f72b4e2-9971-48e3-bbf6-c49b62f99f6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:48.251368 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3f72b4e2-9971-48e3-bbf6-c49b62f99f6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:48.252114 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3f72b4e2-9971-48e3-bbf6-c49b62f99f6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:48.278850 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3f72b4e2-9971-48e3-bbf6-c49b62f99f6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/ips" status: 200 len: 151 microversion: 2.20 time: 0.042191 Sep 01 14:06:48.281957 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 431/835] 10.222.0.61 () {60 vars in 1289 bytes} [Thu Sep 1 14:06:48 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 14:06:48.350024 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0384d998-bb38-4fbc-8d14-7291d101c07f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:48.358163 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0384d998-bb38-4fbc-8d14-7291d101c07f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1366 microversion: 2.1 time: 0.341928 Sep 01 14:06:48.359048 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 405/836] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:48 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:49.381903 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-07112bd9-3310-4f03-95e4-1d702a748fc8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:49.387625 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-07112bd9-3310-4f03-95e4-1d702a748fc8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:49.389443 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-07112bd9-3310-4f03-95e4-1d702a748fc8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:49.389983 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-07112bd9-3310-4f03-95e4-1d702a748fc8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:49.390428 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-07112bd9-3310-4f03-95e4-1d702a748fc8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:49.391143 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-07112bd9-3310-4f03-95e4-1d702a748fc8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:49.391642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-07112bd9-3310-4f03-95e4-1d702a748fc8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:49.392066 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-07112bd9-3310-4f03-95e4-1d702a748fc8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:49.544642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-07112bd9-3310-4f03-95e4-1d702a748fc8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:49.552595 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-07112bd9-3310-4f03-95e4-1d702a748fc8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1366 microversion: 2.1 time: 0.175129 Sep 01 14:06:49.553489 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 432/837] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:49 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:50.574938 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-76901943-e844-4e73-a85f-26332a8d8c29 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:50.575611 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-76901943-e844-4e73-a85f-26332a8d8c29 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:50.582088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76901943-e844-4e73-a85f-26332a8d8c29 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:50.582580 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76901943-e844-4e73-a85f-26332a8d8c29 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:50.583053 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76901943-e844-4e73-a85f-26332a8d8c29 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:50.583742 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76901943-e844-4e73-a85f-26332a8d8c29 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:50.584200 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76901943-e844-4e73-a85f-26332a8d8c29 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:50.584622 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-76901943-e844-4e73-a85f-26332a8d8c29 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:50.722280 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-76901943-e844-4e73-a85f-26332a8d8c29 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:50.731027 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-76901943-e844-4e73-a85f-26332a8d8c29 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1366 microversion: 2.1 time: 0.159946 Sep 01 14:06:50.731607 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 406/838] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:50 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:50.956667 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-28465ab1-fc1b-4e6d-8c14-3246840de79e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:50.957217 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-28465ab1-fc1b-4e6d-8c14-3246840de79e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:50.959615 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:50.960273 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=6 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:50.965185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-28465ab1-fc1b-4e6d-8c14-3246840de79e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:50.965685 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-28465ab1-fc1b-4e6d-8c14-3246840de79e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:50.967160 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-28465ab1-fc1b-4e6d-8c14-3246840de79e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:50.967160 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-28465ab1-fc1b-4e6d-8c14-3246840de79e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:50.967392 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-28465ab1-fc1b-4e6d-8c14-3246840de79e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:50.967822 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-28465ab1-fc1b-4e6d-8c14-3246840de79e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:50.992212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-28465ab1-fc1b-4e6d-8c14-3246840de79e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lazy-loading 'flavor' on Instance uuid aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:06:51.515859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-28465ab1-fc1b-4e6d-8c14-3246840de79e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "POST /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/action" status: 202 len: 0 microversion: 2.20 time: 0.562935 Sep 01 14:06:51.519927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 433/839] 10.222.0.61 () {62 vars in 1319 bytes} [Thu Sep 1 14:06:50 2022] POST /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:06:51.521691 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=6 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:51.527200 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-df015299-05dd-4574-bd05-402445dbaa8b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:51.528365 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-df015299-05dd-4574-bd05-402445dbaa8b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:51.536001 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-df015299-05dd-4574-bd05-402445dbaa8b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.536539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-df015299-05dd-4574-bd05-402445dbaa8b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.536984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-df015299-05dd-4574-bd05-402445dbaa8b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.537991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-df015299-05dd-4574-bd05-402445dbaa8b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.538286 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-df015299-05dd-4574-bd05-402445dbaa8b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.538657 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-df015299-05dd-4574-bd05-402445dbaa8b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.676570 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-df015299-05dd-4574-bd05-402445dbaa8b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:51.685917 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-df015299-05dd-4574-bd05-402445dbaa8b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:51.687570 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-df015299-05dd-4574-bd05-402445dbaa8b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:51.688990 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-df015299-05dd-4574-bd05-402445dbaa8b tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.167718 Sep 01 14:06:51.701935 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 434/840] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:51 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:06:51.739537 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-be591ed2-f20c-4dca-9d1f-cd33cb0c76ae req-f8d40e7e-2d47-4d24-a50c-63f8902585c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66fe2a32-ad87-42ac-8aca-7878f7c65c0c", "name": "network-vif-plugged", "status": "completed", "tag": "552d6bb2-fe64-4e63-a029-3c894cb1f1aa"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:51.749310 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-be591ed2-f20c-4dca-9d1f-cd33cb0c76ae req-f8d40e7e-2d47-4d24-a50c-63f8902585c9 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.749828 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-be591ed2-f20c-4dca-9d1f-cd33cb0c76ae req-f8d40e7e-2d47-4d24-a50c-63f8902585c9 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.750239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-be591ed2-f20c-4dca-9d1f-cd33cb0c76ae req-f8d40e7e-2d47-4d24-a50c-63f8902585c9 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.753301 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2377bdb4-9fb9-4d0a-b260-2bbb206153b6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:51.753965 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2377bdb4-9fb9-4d0a-b260-2bbb206153b6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:51.760608 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2377bdb4-9fb9-4d0a-b260-2bbb206153b6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.761041 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2377bdb4-9fb9-4d0a-b260-2bbb206153b6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.761482 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2377bdb4-9fb9-4d0a-b260-2bbb206153b6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.762234 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2377bdb4-9fb9-4d0a-b260-2bbb206153b6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:51.762690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2377bdb4-9fb9-4d0a-b260-2bbb206153b6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:51.762813 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-be591ed2-f20c-4dca-9d1f-cd33cb0c76ae req-f8d40e7e-2d47-4d24-a50c-63f8902585c9 service nova] Creating event network-vif-plugged:552d6bb2-fe64-4e63-a029-3c894cb1f1aa for instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c on hv-cinder-85221 Sep 01 14:06:51.763116 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2377bdb4-9fb9-4d0a-b260-2bbb206153b6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:51.767912 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-be591ed2-f20c-4dca-9d1f-cd33cb0c76ae req-f8d40e7e-2d47-4d24-a50c-63f8902585c9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.250882 Sep 01 14:06:51.768509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 407/841] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:51.904298 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2377bdb4-9fb9-4d0a-b260-2bbb206153b6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:51.912851 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2377bdb4-9fb9-4d0a-b260-2bbb206153b6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1366 microversion: 2.1 time: 0.163508 Sep 01 14:06:51.914081 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 435/842] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:51 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:06:52.715081 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2bdd949c-f92e-446d-bbd2-4bdab5ee3f99 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:52.715791 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2bdd949c-f92e-446d-bbd2-4bdab5ee3f99 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:52.721911 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2bdd949c-f92e-446d-bbd2-4bdab5ee3f99 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:52.722391 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2bdd949c-f92e-446d-bbd2-4bdab5ee3f99 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:52.722827 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2bdd949c-f92e-446d-bbd2-4bdab5ee3f99 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:52.723513 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2bdd949c-f92e-446d-bbd2-4bdab5ee3f99 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:52.723967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2bdd949c-f92e-446d-bbd2-4bdab5ee3f99 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:52.724390 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2bdd949c-f92e-446d-bbd2-4bdab5ee3f99 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:52.863795 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2bdd949c-f92e-446d-bbd2-4bdab5ee3f99 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:52.867347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:52.872331 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2bdd949c-f92e-446d-bbd2-4bdab5ee3f99 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:52.873758 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2bdd949c-f92e-446d-bbd2-4bdab5ee3f99 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:52.874935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2bdd949c-f92e-446d-bbd2-4bdab5ee3f99 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.165130 Sep 01 14:06:52.875482 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 408/843] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:52 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:52.934421 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b65e94ef-ecf0-4337-afb7-068319eb6042 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:52.935025 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b65e94ef-ecf0-4337-afb7-068319eb6042 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:52.942017 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b65e94ef-ecf0-4337-afb7-068319eb6042 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:52.942515 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b65e94ef-ecf0-4337-afb7-068319eb6042 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:52.942960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b65e94ef-ecf0-4337-afb7-068319eb6042 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:52.943673 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b65e94ef-ecf0-4337-afb7-068319eb6042 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:52.945950 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b65e94ef-ecf0-4337-afb7-068319eb6042 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:52.945950 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b65e94ef-ecf0-4337-afb7-068319eb6042 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:53.078219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-b65e94ef-ecf0-4337-afb7-068319eb6042 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:53.086566 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b65e94ef-ecf0-4337-afb7-068319eb6042 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1366 microversion: 2.1 time: 0.156153 Sep 01 14:06:53.087150 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 436/844] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:52 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:53.904248 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4466faa4-0cb0-4f8b-ba3a-fa541db493e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:53.904855 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4466faa4-0cb0-4f8b-ba3a-fa541db493e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:53.907847 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:53.915352 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4466faa4-0cb0-4f8b-ba3a-fa541db493e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:53.919051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4466faa4-0cb0-4f8b-ba3a-fa541db493e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:53.919051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4466faa4-0cb0-4f8b-ba3a-fa541db493e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:53.919051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4466faa4-0cb0-4f8b-ba3a-fa541db493e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:53.919051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4466faa4-0cb0-4f8b-ba3a-fa541db493e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:53.919416 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4466faa4-0cb0-4f8b-ba3a-fa541db493e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:54.054564 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4466faa4-0cb0-4f8b-ba3a-fa541db493e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:54.063235 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4466faa4-0cb0-4f8b-ba3a-fa541db493e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:54.064692 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4466faa4-0cb0-4f8b-ba3a-fa541db493e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:54.065873 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4466faa4-0cb0-4f8b-ba3a-fa541db493e8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.165660 Sep 01 14:06:54.066474 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 409/845] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:53 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:54.107624 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c37df16d-0c69-422c-8cbc-de6421428343 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:54.108237 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c37df16d-0c69-422c-8cbc-de6421428343 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:54.114692 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c37df16d-0c69-422c-8cbc-de6421428343 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:54.115176 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c37df16d-0c69-422c-8cbc-de6421428343 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:54.115615 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c37df16d-0c69-422c-8cbc-de6421428343 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:54.116352 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c37df16d-0c69-422c-8cbc-de6421428343 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:54.116808 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c37df16d-0c69-422c-8cbc-de6421428343 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:54.117237 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c37df16d-0c69-422c-8cbc-de6421428343 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:54.254107 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c37df16d-0c69-422c-8cbc-de6421428343 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:54.261882 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c37df16d-0c69-422c-8cbc-de6421428343 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1366 microversion: 2.1 time: 0.158160 Sep 01 14:06:54.262458 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 437/846] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:54 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:55.088847 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e285e9c5-498e-48c7-9eb5-4b884214aac8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:55.089617 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e285e9c5-498e-48c7-9eb5-4b884214aac8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:55.096399 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e285e9c5-498e-48c7-9eb5-4b884214aac8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.096892 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e285e9c5-498e-48c7-9eb5-4b884214aac8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.097326 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e285e9c5-498e-48c7-9eb5-4b884214aac8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.098280 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e285e9c5-498e-48c7-9eb5-4b884214aac8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.098546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e285e9c5-498e-48c7-9eb5-4b884214aac8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.099152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e285e9c5-498e-48c7-9eb5-4b884214aac8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.227048 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e285e9c5-498e-48c7-9eb5-4b884214aac8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:55.235225 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e285e9c5-498e-48c7-9eb5-4b884214aac8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:55.236664 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e285e9c5-498e-48c7-9eb5-4b884214aac8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:55.237888 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e285e9c5-498e-48c7-9eb5-4b884214aac8 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.153328 Sep 01 14:06:55.238441 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 410/847] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:55 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:55.283250 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b336e033-ec2c-41e8-b878-7992672c0d64 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:55.283886 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b336e033-ec2c-41e8-b878-7992672c0d64 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:55.286314 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:06:55.291767 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b336e033-ec2c-41e8-b878-7992672c0d64 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.292278 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b336e033-ec2c-41e8-b878-7992672c0d64 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.292774 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b336e033-ec2c-41e8-b878-7992672c0d64 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.293502 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b336e033-ec2c-41e8-b878-7992672c0d64 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.294065 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b336e033-ec2c-41e8-b878-7992672c0d64 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.294567 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b336e033-ec2c-41e8-b878-7992672c0d64 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.433162 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-b336e033-ec2c-41e8-b878-7992672c0d64 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:55.441565 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b336e033-ec2c-41e8-b878-7992672c0d64 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1556 microversion: 2.1 time: 0.162145 Sep 01 14:06:55.442186 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 438/848] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:06:55 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:06:55.462215 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3f87f78b-381b-405d-b348-f0fe26a42d9c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:55.462700 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3f87f78b-381b-405d-b348-f0fe26a42d9c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:55.468851 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3f87f78b-381b-405d-b348-f0fe26a42d9c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.469334 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3f87f78b-381b-405d-b348-f0fe26a42d9c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.469786 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3f87f78b-381b-405d-b348-f0fe26a42d9c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.470520 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3f87f78b-381b-405d-b348-f0fe26a42d9c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:55.470967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3f87f78b-381b-405d-b348-f0fe26a42d9c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:55.471400 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3f87f78b-381b-405d-b348-f0fe26a42d9c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:55.550826 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3f87f78b-381b-405d-b348-f0fe26a42d9c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092558 Sep 01 14:06:55.551451 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 411/849] 10.222.0.61 () {58 vars in 1275 bytes} [Thu Sep 1 14:06:55 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:06:56.261334 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a338fb1c-7690-4c2a-871c-6dece74020d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:56.262051 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a338fb1c-7690-4c2a-871c-6dece74020d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:56.268285 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a338fb1c-7690-4c2a-871c-6dece74020d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:56.268766 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a338fb1c-7690-4c2a-871c-6dece74020d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:56.269196 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a338fb1c-7690-4c2a-871c-6dece74020d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:56.269919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a338fb1c-7690-4c2a-871c-6dece74020d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:56.270371 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a338fb1c-7690-4c2a-871c-6dece74020d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:56.270792 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a338fb1c-7690-4c2a-871c-6dece74020d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:56.404522 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a338fb1c-7690-4c2a-871c-6dece74020d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:56.413042 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a338fb1c-7690-4c2a-871c-6dece74020d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:56.415113 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a338fb1c-7690-4c2a-871c-6dece74020d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:56.416309 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a338fb1c-7690-4c2a-871c-6dece74020d9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.159695 Sep 01 14:06:56.416867 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 439/850] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:56 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:56.543074 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-1c9dbd72-ce23-4c14-8e64-de9fe55de46f req-822da5fe-2d4d-45bc-8cf8-f3d00b030158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66fe2a32-ad87-42ac-8aca-7878f7c65c0c", "tag": "552d6bb2-fe64-4e63-a029-3c894cb1f1aa"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:06:56.552876 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-1c9dbd72-ce23-4c14-8e64-de9fe55de46f req-822da5fe-2d4d-45bc-8cf8-f3d00b030158 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:56.553365 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-1c9dbd72-ce23-4c14-8e64-de9fe55de46f req-822da5fe-2d4d-45bc-8cf8-f3d00b030158 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:56.553816 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-1c9dbd72-ce23-4c14-8e64-de9fe55de46f req-822da5fe-2d4d-45bc-8cf8-f3d00b030158 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:56.565665 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-1c9dbd72-ce23-4c14-8e64-de9fe55de46f req-822da5fe-2d4d-45bc-8cf8-f3d00b030158 service nova] Creating event network-changed:552d6bb2-fe64-4e63-a029-3c894cb1f1aa for instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c on hv-cinder-85221 Sep 01 14:06:56.570740 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-1c9dbd72-ce23-4c14-8e64-de9fe55de46f req-822da5fe-2d4d-45bc-8cf8-f3d00b030158 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032562 Sep 01 14:06:56.571339 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 412/851] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:57.440162 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d2e2298a-d2a1-40d5-8dae-398c4b26a3e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:57.440765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d2e2298a-d2a1-40d5-8dae-398c4b26a3e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:57.448177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d2e2298a-d2a1-40d5-8dae-398c4b26a3e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:57.448661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d2e2298a-d2a1-40d5-8dae-398c4b26a3e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:57.449092 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d2e2298a-d2a1-40d5-8dae-398c4b26a3e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:57.449795 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d2e2298a-d2a1-40d5-8dae-398c4b26a3e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:57.450256 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d2e2298a-d2a1-40d5-8dae-398c4b26a3e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:57.450672 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d2e2298a-d2a1-40d5-8dae-398c4b26a3e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:57.593668 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d2e2298a-d2a1-40d5-8dae-398c4b26a3e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:57.601877 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d2e2298a-d2a1-40d5-8dae-398c4b26a3e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:57.603334 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d2e2298a-d2a1-40d5-8dae-398c4b26a3e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:57.604495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d2e2298a-d2a1-40d5-8dae-398c4b26a3e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.168791 Sep 01 14:06:57.605054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 440/852] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:57 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:58.630071 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-498bb68c-9d77-4e0b-8baa-0866ee3e6241 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:58.630755 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-498bb68c-9d77-4e0b-8baa-0866ee3e6241 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:58.637510 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-498bb68c-9d77-4e0b-8baa-0866ee3e6241 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:58.638026 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-498bb68c-9d77-4e0b-8baa-0866ee3e6241 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:58.638521 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-498bb68c-9d77-4e0b-8baa-0866ee3e6241 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:58.639224 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-498bb68c-9d77-4e0b-8baa-0866ee3e6241 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:58.639682 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-498bb68c-9d77-4e0b-8baa-0866ee3e6241 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:58.640107 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-498bb68c-9d77-4e0b-8baa-0866ee3e6241 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:58.780672 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-498bb68c-9d77-4e0b-8baa-0866ee3e6241 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:58.791073 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-498bb68c-9d77-4e0b-8baa-0866ee3e6241 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:58.792503 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-498bb68c-9d77-4e0b-8baa-0866ee3e6241 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:58.793654 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-498bb68c-9d77-4e0b-8baa-0866ee3e6241 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.168682 Sep 01 14:06:58.794231 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 413/853] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:58 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:06:59.816232 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8807b712-34d0-4206-b2ba-1e37b57fae19 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:59.816858 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8807b712-34d0-4206-b2ba-1e37b57fae19 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:59.823537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8807b712-34d0-4206-b2ba-1e37b57fae19 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:59.824018 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8807b712-34d0-4206-b2ba-1e37b57fae19 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:59.824458 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8807b712-34d0-4206-b2ba-1e37b57fae19 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:59.825157 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8807b712-34d0-4206-b2ba-1e37b57fae19 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:59.825609 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8807b712-34d0-4206-b2ba-1e37b57fae19 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:59.826057 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8807b712-34d0-4206-b2ba-1e37b57fae19 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:59.927445 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-db189b2f-fa2f-4399-8711-3ed021b531c6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:06:59.928097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-db189b2f-fa2f-4399-8711-3ed021b531c6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:06:59.935484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-db189b2f-fa2f-4399-8711-3ed021b531c6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:59.935976 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-db189b2f-fa2f-4399-8711-3ed021b531c6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:59.936418 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-db189b2f-fa2f-4399-8711-3ed021b531c6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:59.937135 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-db189b2f-fa2f-4399-8711-3ed021b531c6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:06:59.937586 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-db189b2f-fa2f-4399-8711-3ed021b531c6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:06:59.938054 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-db189b2f-fa2f-4399-8711-3ed021b531c6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:06:59.962561 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-db189b2f-fa2f-4399-8711-3ed021b531c6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/ips" status: 200 len: 146 microversion: 2.1 time: 0.038883 Sep 01 14:06:59.963068 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 414/854] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 1 14:06:59 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:06:59.974747 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-8807b712-34d0-4206-b2ba-1e37b57fae19 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:59.986535 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-8807b712-34d0-4206-b2ba-1e37b57fae19 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:59.988032 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-8807b712-34d0-4206-b2ba-1e37b57fae19 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:06:59.989161 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8807b712-34d0-4206-b2ba-1e37b57fae19 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.176858 Sep 01 14:06:59.989722 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 441/855] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:06:59 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:01.015387 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1cf40677-f647-402b-97f9-80ceda3613b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:01.016019 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1cf40677-f647-402b-97f9-80ceda3613b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:01.022585 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1cf40677-f647-402b-97f9-80ceda3613b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:01.023074 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1cf40677-f647-402b-97f9-80ceda3613b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:01.023510 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1cf40677-f647-402b-97f9-80ceda3613b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:01.024206 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1cf40677-f647-402b-97f9-80ceda3613b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:01.024658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1cf40677-f647-402b-97f9-80ceda3613b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:01.025086 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1cf40677-f647-402b-97f9-80ceda3613b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:01.152060 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1cf40677-f647-402b-97f9-80ceda3613b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:01.160014 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1cf40677-f647-402b-97f9-80ceda3613b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:01.161447 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1cf40677-f647-402b-97f9-80ceda3613b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:01.162612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1cf40677-f647-402b-97f9-80ceda3613b9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.151177 Sep 01 14:07:01.163212 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 415/856] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:01 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:01.687859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a4636719-9aff-414b-972e-2beac36a36c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ecc67e0-9dfc-43a3-befd-8fefe8f2e56b"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:01.690309 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a4636719-9aff-414b-972e-2beac36a36c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:01.697178 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a4636719-9aff-414b-972e-2beac36a36c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:01.697658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a4636719-9aff-414b-972e-2beac36a36c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:01.698143 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a4636719-9aff-414b-972e-2beac36a36c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:01.698839 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a4636719-9aff-414b-972e-2beac36a36c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:01.699285 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a4636719-9aff-414b-972e-2beac36a36c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:01.699705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a4636719-9aff-414b-972e-2beac36a36c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:02.078684 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:02.186025 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-38c62d8c-364e-4255-aae3-87f7a8f6b9aa tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:02.186650 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-38c62d8c-364e-4255-aae3-87f7a8f6b9aa tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:02.193562 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38c62d8c-364e-4255-aae3-87f7a8f6b9aa tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:02.194149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38c62d8c-364e-4255-aae3-87f7a8f6b9aa tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:02.195227 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38c62d8c-364e-4255-aae3-87f7a8f6b9aa tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:02.196062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38c62d8c-364e-4255-aae3-87f7a8f6b9aa tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:02.196567 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38c62d8c-364e-4255-aae3-87f7a8f6b9aa tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:02.197018 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38c62d8c-364e-4255-aae3-87f7a8f6b9aa tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:02.340264 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-38c62d8c-364e-4255-aae3-87f7a8f6b9aa tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:02.348917 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-38c62d8c-364e-4255-aae3-87f7a8f6b9aa tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:02.350967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-38c62d8c-364e-4255-aae3-87f7a8f6b9aa tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:02.352109 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-38c62d8c-364e-4255-aae3-87f7a8f6b9aa tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.170250 Sep 01 14:07:02.352681 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 416/857] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:02 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:03.149254 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a4636719-9aff-414b-972e-2beac36a36c9 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "POST /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.465110 Sep 01 14:07:03.149949 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 442/858] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:07:01 2022] POST /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments => generated 194 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:03.376150 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9cce1e58-24d5-4b7b-abc5-b89ce9fdeede tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:03.377014 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9cce1e58-24d5-4b7b-abc5-b89ce9fdeede tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:03.384332 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cce1e58-24d5-4b7b-abc5-b89ce9fdeede tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:03.384828 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cce1e58-24d5-4b7b-abc5-b89ce9fdeede tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:03.385272 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cce1e58-24d5-4b7b-abc5-b89ce9fdeede tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:03.386063 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cce1e58-24d5-4b7b-abc5-b89ce9fdeede tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:03.386616 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cce1e58-24d5-4b7b-abc5-b89ce9fdeede tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:03.386960 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9cce1e58-24d5-4b7b-abc5-b89ce9fdeede tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:03.533459 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9cce1e58-24d5-4b7b-abc5-b89ce9fdeede tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:03.542262 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9cce1e58-24d5-4b7b-abc5-b89ce9fdeede tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:03.543714 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9cce1e58-24d5-4b7b-abc5-b89ce9fdeede tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:03.544886 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9cce1e58-24d5-4b7b-abc5-b89ce9fdeede tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.172709 Sep 01 14:07:03.545432 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 417/859] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:03 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:04.569703 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3bbf8d95-d034-4158-82d1-ed8fc77ed831 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:04.570369 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3bbf8d95-d034-4158-82d1-ed8fc77ed831 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:04.576661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3bbf8d95-d034-4158-82d1-ed8fc77ed831 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:04.577142 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3bbf8d95-d034-4158-82d1-ed8fc77ed831 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:04.577575 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3bbf8d95-d034-4158-82d1-ed8fc77ed831 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:04.578404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3bbf8d95-d034-4158-82d1-ed8fc77ed831 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:04.578850 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3bbf8d95-d034-4158-82d1-ed8fc77ed831 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:04.579267 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3bbf8d95-d034-4158-82d1-ed8fc77ed831 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:04.712543 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3bbf8d95-d034-4158-82d1-ed8fc77ed831 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:04.720772 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3bbf8d95-d034-4158-82d1-ed8fc77ed831 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:04.722279 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3bbf8d95-d034-4158-82d1-ed8fc77ed831 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:04.723475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3bbf8d95-d034-4158-82d1-ed8fc77ed831 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.159124 Sep 01 14:07:04.724102 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 443/860] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:04 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:05.747745 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a1237c49-e87c-4182-a553-532ef20d8b98 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:05.748513 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a1237c49-e87c-4182-a553-532ef20d8b98 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:05.756027 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a1237c49-e87c-4182-a553-532ef20d8b98 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:05.756538 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a1237c49-e87c-4182-a553-532ef20d8b98 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:05.757676 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a1237c49-e87c-4182-a553-532ef20d8b98 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:05.758549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a1237c49-e87c-4182-a553-532ef20d8b98 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:05.759396 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a1237c49-e87c-4182-a553-532ef20d8b98 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:05.759877 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a1237c49-e87c-4182-a553-532ef20d8b98 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:05.918742 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a1237c49-e87c-4182-a553-532ef20d8b98 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:05.928165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a1237c49-e87c-4182-a553-532ef20d8b98 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:05.929761 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a1237c49-e87c-4182-a553-532ef20d8b98 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:05.930992 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a1237c49-e87c-4182-a553-532ef20d8b98 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.187737 Sep 01 14:07:05.931556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 418/861] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:05 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:06.954386 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-fba4e8bf-f2dd-4435-b606-701f3d62b514 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:06.955013 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-fba4e8bf-f2dd-4435-b606-701f3d62b514 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:06.961985 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fba4e8bf-f2dd-4435-b606-701f3d62b514 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:06.962517 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fba4e8bf-f2dd-4435-b606-701f3d62b514 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:06.962958 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fba4e8bf-f2dd-4435-b606-701f3d62b514 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:06.963714 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fba4e8bf-f2dd-4435-b606-701f3d62b514 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:06.964235 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fba4e8bf-f2dd-4435-b606-701f3d62b514 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:06.964681 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fba4e8bf-f2dd-4435-b606-701f3d62b514 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:07.114703 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fba4e8bf-f2dd-4435-b606-701f3d62b514 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:07.123931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fba4e8bf-f2dd-4435-b606-701f3d62b514 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:07.125406 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fba4e8bf-f2dd-4435-b606-701f3d62b514 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:07.126668 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-fba4e8bf-f2dd-4435-b606-701f3d62b514 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.176300 Sep 01 14:07:07.127497 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 444/862] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:06 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:08.150364 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f76e0eae-eb96-4a07-9016-d811555fd3f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:08.151010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f76e0eae-eb96-4a07-9016-d811555fd3f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:08.157674 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f76e0eae-eb96-4a07-9016-d811555fd3f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:08.158386 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f76e0eae-eb96-4a07-9016-d811555fd3f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:08.158880 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f76e0eae-eb96-4a07-9016-d811555fd3f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:08.159599 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f76e0eae-eb96-4a07-9016-d811555fd3f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:08.160061 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f76e0eae-eb96-4a07-9016-d811555fd3f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:08.160496 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f76e0eae-eb96-4a07-9016-d811555fd3f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:08.311481 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f76e0eae-eb96-4a07-9016-d811555fd3f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:08.321182 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f76e0eae-eb96-4a07-9016-d811555fd3f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:08.322694 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f76e0eae-eb96-4a07-9016-d811555fd3f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:08.324088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f76e0eae-eb96-4a07-9016-d811555fd3f5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.177967 Sep 01 14:07:08.324689 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 419/863] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:08 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:09.347352 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3b6a26dc-2885-4618-b404-a0c9a0c66227 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:09.347963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3b6a26dc-2885-4618-b404-a0c9a0c66227 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:09.354565 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b6a26dc-2885-4618-b404-a0c9a0c66227 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:09.355054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b6a26dc-2885-4618-b404-a0c9a0c66227 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:09.355496 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b6a26dc-2885-4618-b404-a0c9a0c66227 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:09.356193 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b6a26dc-2885-4618-b404-a0c9a0c66227 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:09.356645 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b6a26dc-2885-4618-b404-a0c9a0c66227 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:09.357069 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b6a26dc-2885-4618-b404-a0c9a0c66227 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:09.500003 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3b6a26dc-2885-4618-b404-a0c9a0c66227 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:09.509801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3b6a26dc-2885-4618-b404-a0c9a0c66227 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:09.511266 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3b6a26dc-2885-4618-b404-a0c9a0c66227 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:09.512580 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3b6a26dc-2885-4618-b404-a0c9a0c66227 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.169302 Sep 01 14:07:09.513158 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 445/864] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:09 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:10.535889 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e87041a0-7deb-429e-a2d8-a90ef62c53b7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:10.536529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e87041a0-7deb-429e-a2d8-a90ef62c53b7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:10.543065 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e87041a0-7deb-429e-a2d8-a90ef62c53b7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:10.543547 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e87041a0-7deb-429e-a2d8-a90ef62c53b7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:10.543983 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e87041a0-7deb-429e-a2d8-a90ef62c53b7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:10.544684 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e87041a0-7deb-429e-a2d8-a90ef62c53b7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:10.545133 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e87041a0-7deb-429e-a2d8-a90ef62c53b7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:10.545559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e87041a0-7deb-429e-a2d8-a90ef62c53b7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:10.690905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e87041a0-7deb-429e-a2d8-a90ef62c53b7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:10.700905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e87041a0-7deb-429e-a2d8-a90ef62c53b7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:10.700905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e87041a0-7deb-429e-a2d8-a90ef62c53b7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:10.701661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e87041a0-7deb-429e-a2d8-a90ef62c53b7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.169660 Sep 01 14:07:10.716941 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 420/865] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:10 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:11.725837 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-bd769965-9463-4f13-9c89-158a7b9dd962 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:11.726613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-bd769965-9463-4f13-9c89-158a7b9dd962 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:11.737031 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bd769965-9463-4f13-9c89-158a7b9dd962 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:11.737031 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bd769965-9463-4f13-9c89-158a7b9dd962 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:11.737031 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bd769965-9463-4f13-9c89-158a7b9dd962 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:11.737031 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bd769965-9463-4f13-9c89-158a7b9dd962 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:11.737435 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bd769965-9463-4f13-9c89-158a7b9dd962 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:11.737857 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bd769965-9463-4f13-9c89-158a7b9dd962 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:11.764735 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-39f248e8-b87c-4200-9d93-c806ad128f1e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:11.766967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-39f248e8-b87c-4200-9d93-c806ad128f1e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:11.773581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-39f248e8-b87c-4200-9d93-c806ad128f1e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:11.774105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-39f248e8-b87c-4200-9d93-c806ad128f1e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:11.774625 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-39f248e8-b87c-4200-9d93-c806ad128f1e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:11.775243 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-39f248e8-b87c-4200-9d93-c806ad128f1e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:11.775694 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-39f248e8-b87c-4200-9d93-c806ad128f1e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:11.776115 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-39f248e8-b87c-4200-9d93-c806ad128f1e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:11.808016 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-39f248e8-b87c-4200-9d93-c806ad128f1e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047052 Sep 01 14:07:11.808531 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 421/866] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:07:11 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:07:11.819963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-78cef6f7-800f-48b7-b8f6-4265d2cfc652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:11.820453 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-78cef6f7-800f-48b7-b8f6-4265d2cfc652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:11.826798 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78cef6f7-800f-48b7-b8f6-4265d2cfc652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:11.826996 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78cef6f7-800f-48b7-b8f6-4265d2cfc652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:11.827433 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78cef6f7-800f-48b7-b8f6-4265d2cfc652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:11.828141 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78cef6f7-800f-48b7-b8f6-4265d2cfc652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:11.828713 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78cef6f7-800f-48b7-b8f6-4265d2cfc652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:11.829019 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-78cef6f7-800f-48b7-b8f6-4265d2cfc652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:11.862008 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-78cef6f7-800f-48b7-b8f6-4265d2cfc652 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments/8ecc67e0-9dfc-43a3-befd-8fefe8f2e56b" status: 200 len: 194 microversion: 2.1 time: 0.046560 Sep 01 14:07:11.862627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 422/867] 10.222.0.61 () {58 vars in 1413 bytes} [Thu Sep 1 14:07:11 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments/8ecc67e0-9dfc-43a3-befd-8fefe8f2e56b => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:07:11.888510 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-bd769965-9463-4f13-9c89-158a7b9dd962 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:11.897110 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-bd769965-9463-4f13-9c89-158a7b9dd962 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:11.898688 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-bd769965-9463-4f13-9c89-158a7b9dd962 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:11.899847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-bd769965-9463-4f13-9c89-158a7b9dd962 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.178911 Sep 01 14:07:11.900410 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 446/868] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:11 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:12.245184 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9e3cb134-d6cd-4b3d-9074-fbe9311a43e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:12.245682 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9e3cb134-d6cd-4b3d-9074-fbe9311a43e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:12.252368 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9e3cb134-d6cd-4b3d-9074-fbe9311a43e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:12.252866 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9e3cb134-d6cd-4b3d-9074-fbe9311a43e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:12.253337 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9e3cb134-d6cd-4b3d-9074-fbe9311a43e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:12.254088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9e3cb134-d6cd-4b3d-9074-fbe9311a43e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:12.254553 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9e3cb134-d6cd-4b3d-9074-fbe9311a43e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:12.255017 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9e3cb134-d6cd-4b3d-9074-fbe9311a43e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:12.340564 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-9e3cb134-d6cd-4b3d-9074-fbe9311a43e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'services' on Instance uuid 901d0282-c949-4f4d-9f04-7141c3b42480 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:12.566319 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9e3cb134-d6cd-4b3d-9074-fbe9311a43e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "DELETE /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-volume_attachments/402293c6-238b-4b8c-86ac-ac2402ded0c6" status: 202 len: 0 microversion: 2.1 time: 0.325716 Sep 01 14:07:12.574442 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 423/869] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 1 14:07:12 2022] DELETE /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-volume_attachments/402293c6-238b-4b8c-86ac-ac2402ded0c6 => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:07:12.576956 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d148d60c-4526-4cf0-83d7-de6ba288a445 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:12.580294 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d148d60c-4526-4cf0-83d7-de6ba288a445 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:12.587172 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d148d60c-4526-4cf0-83d7-de6ba288a445 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:12.587636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d148d60c-4526-4cf0-83d7-de6ba288a445 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:12.588028 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d148d60c-4526-4cf0-83d7-de6ba288a445 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:12.588648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d148d60c-4526-4cf0-83d7-de6ba288a445 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:12.589109 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d148d60c-4526-4cf0-83d7-de6ba288a445 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:12.589540 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d148d60c-4526-4cf0-83d7-de6ba288a445 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:12.620601 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d148d60c-4526-4cf0-83d7-de6ba288a445 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048995 Sep 01 14:07:12.621195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 447/870] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:07:12 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:12.923956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-781cba16-0c87-4315-8fc0-c71af72fbe92 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:12.924655 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-781cba16-0c87-4315-8fc0-c71af72fbe92 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:12.931280 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-781cba16-0c87-4315-8fc0-c71af72fbe92 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:12.931774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-781cba16-0c87-4315-8fc0-c71af72fbe92 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:12.932246 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-781cba16-0c87-4315-8fc0-c71af72fbe92 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:12.932970 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-781cba16-0c87-4315-8fc0-c71af72fbe92 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:12.933428 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-781cba16-0c87-4315-8fc0-c71af72fbe92 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:12.933883 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-781cba16-0c87-4315-8fc0-c71af72fbe92 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:13.070289 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-781cba16-0c87-4315-8fc0-c71af72fbe92 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:13.078886 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-781cba16-0c87-4315-8fc0-c71af72fbe92 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:13.080332 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-781cba16-0c87-4315-8fc0-c71af72fbe92 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:13.081494 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-781cba16-0c87-4315-8fc0-c71af72fbe92 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1744 microversion: 2.20 time: 0.162287 Sep 01 14:07:13.082092 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 424/871] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:12 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:13.557606 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1989f917-8fa0-42a7-aa14-3f7ae17da4f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67be0017-8dc7-48e2-bbb5-5717ffe1a606"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:13.560125 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1989f917-8fa0-42a7-aa14-3f7ae17da4f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:13.566773 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1989f917-8fa0-42a7-aa14-3f7ae17da4f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:13.567225 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1989f917-8fa0-42a7-aa14-3f7ae17da4f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:13.567666 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1989f917-8fa0-42a7-aa14-3f7ae17da4f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:13.568366 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1989f917-8fa0-42a7-aa14-3f7ae17da4f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:13.569421 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1989f917-8fa0-42a7-aa14-3f7ae17da4f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:13.569886 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1989f917-8fa0-42a7-aa14-3f7ae17da4f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:13.633015 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-283810dd-235b-4e7c-a13a-7c371262a313 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:13.635319 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-283810dd-235b-4e7c-a13a-7c371262a313 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:13.641497 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-283810dd-235b-4e7c-a13a-7c371262a313 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:13.642030 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-283810dd-235b-4e7c-a13a-7c371262a313 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:13.642481 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-283810dd-235b-4e7c-a13a-7c371262a313 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:13.643201 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-283810dd-235b-4e7c-a13a-7c371262a313 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:13.643663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-283810dd-235b-4e7c-a13a-7c371262a313 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:13.644094 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-283810dd-235b-4e7c-a13a-7c371262a313 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:13.676566 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-283810dd-235b-4e7c-a13a-7c371262a313 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047525 Sep 01 14:07:13.677157 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 425/872] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:07:13 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:07:14.105935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4ed0dbc5-5c25-4ddf-b297-91b4d06aed37 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:14.105935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4ed0dbc5-5c25-4ddf-b297-91b4d06aed37 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:14.112886 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4ed0dbc5-5c25-4ddf-b297-91b4d06aed37 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:14.113376 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4ed0dbc5-5c25-4ddf-b297-91b4d06aed37 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:14.113831 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4ed0dbc5-5c25-4ddf-b297-91b4d06aed37 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:14.114538 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4ed0dbc5-5c25-4ddf-b297-91b4d06aed37 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:14.114990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4ed0dbc5-5c25-4ddf-b297-91b4d06aed37 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:14.115416 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4ed0dbc5-5c25-4ddf-b297-91b4d06aed37 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:14.119877 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:14.254257 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4ed0dbc5-5c25-4ddf-b297-91b4d06aed37 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:14.262632 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4ed0dbc5-5c25-4ddf-b297-91b4d06aed37 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:14.267035 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4ed0dbc5-5c25-4ddf-b297-91b4d06aed37 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:14.267035 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4ed0dbc5-5c25-4ddf-b297-91b4d06aed37 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1744 microversion: 2.20 time: 0.163893 Sep 01 14:07:14.267035 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 426/873] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:14 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:14.446013 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1989f917-8fa0-42a7-aa14-3f7ae17da4f2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "POST /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893241 Sep 01 14:07:14.446673 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 448/874] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:07:13 2022] POST /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments => generated 194 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:14.689416 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a9ce2fd8-4203-4859-8e2f-1f7e80b62f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:14.691963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a9ce2fd8-4203-4859-8e2f-1f7e80b62f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:14.698253 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a9ce2fd8-4203-4859-8e2f-1f7e80b62f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:14.698742 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a9ce2fd8-4203-4859-8e2f-1f7e80b62f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:14.699207 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a9ce2fd8-4203-4859-8e2f-1f7e80b62f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:14.699913 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a9ce2fd8-4203-4859-8e2f-1f7e80b62f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:14.700371 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a9ce2fd8-4203-4859-8e2f-1f7e80b62f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:14.700827 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a9ce2fd8-4203-4859-8e2f-1f7e80b62f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:14.734384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a9ce2fd8-4203-4859-8e2f-1f7e80b62f9c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049302 Sep 01 14:07:14.735304 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 427/875] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:07:14 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:07:14.821033 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8b93550f-a761-47d2-8234-beca9076745c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:14.822268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8b93550f-a761-47d2-8234-beca9076745c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:14.828533 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b93550f-a761-47d2-8234-beca9076745c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:14.829027 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b93550f-a761-47d2-8234-beca9076745c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:14.829460 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b93550f-a761-47d2-8234-beca9076745c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:14.830193 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b93550f-a761-47d2-8234-beca9076745c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:14.830649 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b93550f-a761-47d2-8234-beca9076745c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:14.831072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8b93550f-a761-47d2-8234-beca9076745c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:14.856726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8b93550f-a761-47d2-8234-beca9076745c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Going to try to terminate instance {{(pid=127811) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:07:15.263942 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8b93550f-a761-47d2-8234-beca9076745c tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "DELETE /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 204 len: 0 microversion: 2.1 time: 0.447491 Sep 01 14:07:15.264858 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 449/876] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:07:14 2022] DELETE /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:07:15.272987 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-19f8feb3-d737-4a60-a8c4-e97c03214442 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:15.273643 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-19f8feb3-d737-4a60-a8c4-e97c03214442 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:15.280481 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-19f8feb3-d737-4a60-a8c4-e97c03214442 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:15.280965 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-19f8feb3-d737-4a60-a8c4-e97c03214442 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:15.281413 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-19f8feb3-d737-4a60-a8c4-e97c03214442 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:15.282221 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-19f8feb3-d737-4a60-a8c4-e97c03214442 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:15.282681 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-19f8feb3-d737-4a60-a8c4-e97c03214442 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:15.283118 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-19f8feb3-d737-4a60-a8c4-e97c03214442 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:15.290624 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cb2adb4c-b53b-4b74-b561-f68c73c3cea3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:15.291634 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-cb2adb4c-b53b-4b74-b561-f68c73c3cea3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:15.298221 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cb2adb4c-b53b-4b74-b561-f68c73c3cea3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:15.298699 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cb2adb4c-b53b-4b74-b561-f68c73c3cea3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:15.299304 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cb2adb4c-b53b-4b74-b561-f68c73c3cea3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:15.300173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cb2adb4c-b53b-4b74-b561-f68c73c3cea3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:15.300627 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cb2adb4c-b53b-4b74-b561-f68c73c3cea3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:15.301145 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cb2adb4c-b53b-4b74-b561-f68c73c3cea3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:15.522523 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-19f8feb3-d737-4a60-a8c4-e97c03214442 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:15.526633 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cb2adb4c-b53b-4b74-b561-f68c73c3cea3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:15.531364 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-19f8feb3-d737-4a60-a8c4-e97c03214442 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1689 microversion: 2.1 time: 0.262407 Sep 01 14:07:15.532111 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 428/877] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:15 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1689 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:15.542655 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cb2adb4c-b53b-4b74-b561-f68c73c3cea3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:15.544949 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cb2adb4c-b53b-4b74-b561-f68c73c3cea3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:15.546503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cb2adb4c-b53b-4b74-b561-f68c73c3cea3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1739 microversion: 2.20 time: 0.260653 Sep 01 14:07:15.547793 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 450/878] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:15 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:16.559285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5394db4f-0e07-4696-8877-b3bbdf243eb8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:16.560954 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5394db4f-0e07-4696-8877-b3bbdf243eb8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:16.574471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e2170207-544c-4531-8b37-0070236378fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:16.575791 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e2170207-544c-4531-8b37-0070236378fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:16.585868 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5394db4f-0e07-4696-8877-b3bbdf243eb8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:16.589171 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e2170207-544c-4531-8b37-0070236378fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:16.590210 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5394db4f-0e07-4696-8877-b3bbdf243eb8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:16.591446 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5394db4f-0e07-4696-8877-b3bbdf243eb8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:16.592240 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e2170207-544c-4531-8b37-0070236378fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:16.593281 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5394db4f-0e07-4696-8877-b3bbdf243eb8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:16.594732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5394db4f-0e07-4696-8877-b3bbdf243eb8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:16.595218 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e2170207-544c-4531-8b37-0070236378fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:16.596177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e2170207-544c-4531-8b37-0070236378fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:16.596859 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5394db4f-0e07-4696-8877-b3bbdf243eb8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:16.598664 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e2170207-544c-4531-8b37-0070236378fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:16.600342 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e2170207-544c-4531-8b37-0070236378fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:16.852255 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e2170207-544c-4531-8b37-0070236378fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:16.868229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e2170207-544c-4531-8b37-0070236378fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:16.869951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e2170207-544c-4531-8b37-0070236378fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:16.875816 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e2170207-544c-4531-8b37-0070236378fe tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1739 microversion: 2.20 time: 0.305864 Sep 01 14:07:16.883316 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5394db4f-0e07-4696-8877-b3bbdf243eb8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:16.890694 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 451/879] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:16 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1739 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:16.898186 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5394db4f-0e07-4696-8877-b3bbdf243eb8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1689 microversion: 2.1 time: 0.348203 Sep 01 14:07:16.899110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 429/880] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:16 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1689 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:17.530683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-d9dcdbd5-1479-46b9-93b2-6ae660f12100 req-6c71f757-c2cc-4f60-a8c9-bbd25d17e647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacf49fd-7b35-4e19-81f0-098fc9d2b0d6", "name": "network-vif-plugged", "status": "completed", "tag": "fce10985-ae68-4e7b-beef-fef3f597b453"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:17.545881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-d9dcdbd5-1479-46b9-93b2-6ae660f12100 req-6c71f757-c2cc-4f60-a8c9-bbd25d17e647 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:17.552781 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-d9dcdbd5-1479-46b9-93b2-6ae660f12100 req-6c71f757-c2cc-4f60-a8c9-bbd25d17e647 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:17.552781 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-d9dcdbd5-1479-46b9-93b2-6ae660f12100 req-6c71f757-c2cc-4f60-a8c9-bbd25d17e647 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:17.559179 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-d9dcdbd5-1479-46b9-93b2-6ae660f12100 req-6c71f757-c2cc-4f60-a8c9-bbd25d17e647 service nova] Creating event network-vif-plugged:fce10985-ae68-4e7b-beef-fef3f597b453 for instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 on hv-cinder-85221 Sep 01 14:07:17.565031 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-d9dcdbd5-1479-46b9-93b2-6ae660f12100 req-6c71f757-c2cc-4f60-a8c9-bbd25d17e647 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037879 Sep 01 14:07:17.565031 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 452/881] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:17.901512 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-43e9512c-bada-4f0f-b362-dc91bae470cf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:17.902997 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-43e9512c-bada-4f0f-b362-dc91bae470cf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:17.910232 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-43e9512c-bada-4f0f-b362-dc91bae470cf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:17.910712 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-43e9512c-bada-4f0f-b362-dc91bae470cf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:17.911355 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-43e9512c-bada-4f0f-b362-dc91bae470cf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:17.912219 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-43e9512c-bada-4f0f-b362-dc91bae470cf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:17.912665 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-43e9512c-bada-4f0f-b362-dc91bae470cf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:17.913412 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-43e9512c-bada-4f0f-b362-dc91bae470cf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:18.078837 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-43e9512c-bada-4f0f-b362-dc91bae470cf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:18.088252 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-651ed245-69ab-49a6-8ad2-3e72e036de5e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:18.097948 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-651ed245-69ab-49a6-8ad2-3e72e036de5e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:18.098117 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-43e9512c-bada-4f0f-b362-dc91bae470cf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:18.098234 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-651ed245-69ab-49a6-8ad2-3e72e036de5e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:18.098234 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-651ed245-69ab-49a6-8ad2-3e72e036de5e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:18.098680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-651ed245-69ab-49a6-8ad2-3e72e036de5e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:18.099412 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-43e9512c-bada-4f0f-b362-dc91bae470cf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:18.099548 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-651ed245-69ab-49a6-8ad2-3e72e036de5e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:18.099934 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-651ed245-69ab-49a6-8ad2-3e72e036de5e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:18.100359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-651ed245-69ab-49a6-8ad2-3e72e036de5e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:18.100869 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-43e9512c-bada-4f0f-b362-dc91bae470cf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1739 microversion: 2.20 time: 0.204442 Sep 01 14:07:18.101480 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 430/882] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:17 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:18.243753 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-651ed245-69ab-49a6-8ad2-3e72e036de5e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:18.251458 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-651ed245-69ab-49a6-8ad2-3e72e036de5e tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1689 microversion: 2.1 time: 0.333812 Sep 01 14:07:18.252267 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 453/883] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:17 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1689 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:19.126957 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-79567051-dbf4-43ff-84ce-46669a9383de tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:19.127999 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-79567051-dbf4-43ff-84ce-46669a9383de tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:19.135906 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79567051-dbf4-43ff-84ce-46669a9383de tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:19.136535 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79567051-dbf4-43ff-84ce-46669a9383de tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:19.137064 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79567051-dbf4-43ff-84ce-46669a9383de tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:19.138834 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79567051-dbf4-43ff-84ce-46669a9383de tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:19.139553 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79567051-dbf4-43ff-84ce-46669a9383de tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:19.140196 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79567051-dbf4-43ff-84ce-46669a9383de tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:19.275321 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-45803991-781d-4448-9371-049ae38b15e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:19.276513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-45803991-781d-4448-9371-049ae38b15e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:19.283428 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-45803991-781d-4448-9371-049ae38b15e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:19.284155 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-45803991-781d-4448-9371-049ae38b15e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:19.284789 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-45803991-781d-4448-9371-049ae38b15e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:19.285653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-45803991-781d-4448-9371-049ae38b15e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:19.286285 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-45803991-781d-4448-9371-049ae38b15e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:19.286874 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-45803991-781d-4448-9371-049ae38b15e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:19.474882 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-79567051-dbf4-43ff-84ce-46669a9383de tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:19.497059 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-79567051-dbf4-43ff-84ce-46669a9383de tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:19.502501 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-79567051-dbf4-43ff-84ce-46669a9383de tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:19.502501 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-79567051-dbf4-43ff-84ce-46669a9383de tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1739 microversion: 2.20 time: 0.377097 Sep 01 14:07:19.502501 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 431/884] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:19 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1739 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:19.536055 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-45803991-781d-4448-9371-049ae38b15e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:19.545346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-45803991-781d-4448-9371-049ae38b15e1 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1689 microversion: 2.1 time: 0.275443 Sep 01 14:07:19.560593 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 454/885] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:19 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1689 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:20.373103 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-8aa4aefa-c9fe-4a42-abe7-535392e6009e req-dbed8f26-4ab4-4c8b-9eca-7a199c0b54c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "901d0282-c949-4f4d-9f04-7141c3b42480", "name": "network-vif-deleted", "tag": "79b8068f-760a-42ca-86d8-b6f065560433"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:20.389300 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-8aa4aefa-c9fe-4a42-abe7-535392e6009e req-dbed8f26-4ab4-4c8b-9eca-7a199c0b54c2 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:20.390100 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-8aa4aefa-c9fe-4a42-abe7-535392e6009e req-dbed8f26-4ab4-4c8b-9eca-7a199c0b54c2 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:20.390785 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-8aa4aefa-c9fe-4a42-abe7-535392e6009e req-dbed8f26-4ab4-4c8b-9eca-7a199c0b54c2 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:20.405716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-8aa4aefa-c9fe-4a42-abe7-535392e6009e req-dbed8f26-4ab4-4c8b-9eca-7a199c0b54c2 service nova] Creating event network-vif-deleted:79b8068f-760a-42ca-86d8-b6f065560433 for instance 901d0282-c949-4f4d-9f04-7141c3b42480 on hv-cinder-85221 Sep 01 14:07:20.413637 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-8aa4aefa-c9fe-4a42-abe7-535392e6009e req-dbed8f26-4ab4-4c8b-9eca-7a199c0b54c2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044004 Sep 01 14:07:20.418817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 432/886] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:20.531529 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-631ac6be-a6c7-4a3e-abee-129f490349f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:20.532150 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-631ac6be-a6c7-4a3e-abee-129f490349f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:20.546265 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-631ac6be-a6c7-4a3e-abee-129f490349f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:20.546265 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-631ac6be-a6c7-4a3e-abee-129f490349f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:20.546265 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-631ac6be-a6c7-4a3e-abee-129f490349f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:20.550646 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-631ac6be-a6c7-4a3e-abee-129f490349f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:20.551409 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-631ac6be-a6c7-4a3e-abee-129f490349f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:20.552648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-631ac6be-a6c7-4a3e-abee-129f490349f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:20.578308 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-be3b33e8-fdb4-4e5d-9227-e36e2c17c8b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:20.580733 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-be3b33e8-fdb4-4e5d-9227-e36e2c17c8b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:20.592305 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be3b33e8-fdb4-4e5d-9227-e36e2c17c8b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:20.593205 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be3b33e8-fdb4-4e5d-9227-e36e2c17c8b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:20.594036 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be3b33e8-fdb4-4e5d-9227-e36e2c17c8b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:20.595340 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be3b33e8-fdb4-4e5d-9227-e36e2c17c8b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:20.596119 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be3b33e8-fdb4-4e5d-9227-e36e2c17c8b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:20.596734 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-be3b33e8-fdb4-4e5d-9227-e36e2c17c8b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:20.745700 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-be3b33e8-fdb4-4e5d-9227-e36e2c17c8b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:20.756111 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-be3b33e8-fdb4-4e5d-9227-e36e2c17c8b6 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1329 microversion: 2.1 time: 0.192574 Sep 01 14:07:20.756784 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 433/887] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:20 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1329 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:20.843683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-631ac6be-a6c7-4a3e-abee-129f490349f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:20.861265 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-631ac6be-a6c7-4a3e-abee-129f490349f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:20.862785 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-631ac6be-a6c7-4a3e-abee-129f490349f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:20.864000 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-631ac6be-a6c7-4a3e-abee-129f490349f0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1739 microversion: 2.20 time: 0.337213 Sep 01 14:07:20.864558 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 455/888] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:20 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1739 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:21.779424 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:21.780256 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:21.787767 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:21.788259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:21.788725 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:21.789560 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:21.790095 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:21.790608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:21.832220 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:21.833057 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:21.833521 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:21.834070 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'fault' on Instance uuid 901d0282-c949-4f4d-9f04-7141c3b42480 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:21.885750 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:21.892350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e212101d-41c7-4e56-89e7-8a328e9ab8fd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:21.893100 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e212101d-41c7-4e56-89e7-8a328e9ab8fd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:21.893873 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-38a85421-3b7f-4670-a495-5f344690222b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 200 len: 1334 microversion: 2.1 time: 0.119726 Sep 01 14:07:21.894463 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 434/889] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:21 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 1334 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:21.901300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e212101d-41c7-4e56-89e7-8a328e9ab8fd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:21.901986 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e212101d-41c7-4e56-89e7-8a328e9ab8fd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:21.902563 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e212101d-41c7-4e56-89e7-8a328e9ab8fd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:21.903457 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e212101d-41c7-4e56-89e7-8a328e9ab8fd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:21.904027 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e212101d-41c7-4e56-89e7-8a328e9ab8fd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:21.904700 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e212101d-41c7-4e56-89e7-8a328e9ab8fd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:21.928908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:22.061097 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e212101d-41c7-4e56-89e7-8a328e9ab8fd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:22.073348 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e212101d-41c7-4e56-89e7-8a328e9ab8fd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:22.075789 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e212101d-41c7-4e56-89e7-8a328e9ab8fd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:22.076991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e212101d-41c7-4e56-89e7-8a328e9ab8fd tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1739 microversion: 2.20 time: 0.189726 Sep 01 14:07:22.077918 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 456/890] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:21 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:22.920967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ecf1c325-a251-4649-a030-049d44f7bb4d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:22.922409 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ecf1c325-a251-4649-a030-049d44f7bb4d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 901d0282-c949-4f4d-9f04-7141c3b42480] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:22.934897 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecf1c325-a251-4649-a030-049d44f7bb4d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:22.936472 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecf1c325-a251-4649-a030-049d44f7bb4d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:22.938227 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecf1c325-a251-4649-a030-049d44f7bb4d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:22.942192 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecf1c325-a251-4649-a030-049d44f7bb4d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:22.943875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecf1c325-a251-4649-a030-049d44f7bb4d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:22.945034 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecf1c325-a251-4649-a030-049d44f7bb4d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:22.979598 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-ecf1c325-a251-4649-a030-049d44f7bb4d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] HTTP exception thrown: Instance 901d0282-c949-4f4d-9f04-7141c3b42480 could not be found. Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ecf1c325-a251-4649-a030-049d44f7bb4d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Request method failure captured: Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 HTTP/1.1 Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELtodHK0hlU0ssq5VsVzMh6Isxe-uCStXQYmXx3WC5v-cWde1ZtUEz4tBUd99Izqseob2wB5HoMDtngWz9-8nQFIx5OnaExar3GImRdIpuyNt3odGrByyBSZ4Yaf1qZx3OBIwh6RmJIDNKvWbLt58dvpxlaGOkEb_1yXcgptrN7a0EY Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: dce10589b8b240e6829f2e158415a1b8 Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:07:22.982608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:07:22.984123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dce10589b8b240e6829f2e158415a1b8"}]}] Sep 01 14:07:22.984123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:07:22.984123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: dce10589b8b240e6829f2e158415a1b8 Sep 01 14:07:22.984123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:07:22.984123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-ServerRescueNegativeTestJSON-1978503690-project Sep 01 14:07:22.984123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:07:22.984123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:07:22.984123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 65c88d8b86544ab5825adbadb26b1e2e Sep 01 14:07:22.984123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1978503690-project Sep 01 14:07:22.984123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:07:22.984123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 901d0282-c949-4f4d-9f04-7141c3b42480 could not be found. Sep 01 14:07:22.984123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '901d0282-c949-4f4d-9f04-7141c3b42480'} Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 901d0282-c949-4f4d-9f04-7141c3b42480 could not be found. Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:07:22.984900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 901d0282-c949-4f4d-9f04-7141c3b42480 could not be found. Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 901d0282-c949-4f4d-9f04-7141c3b42480 could not be found. Sep 01 14:07:22.986774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:22.988043 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ecf1c325-a251-4649-a030-049d44f7bb4d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Returning 404 to user: Instance 901d0282-c949-4f4d-9f04-7141c3b42480 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:07:22.988043 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ecf1c325-a251-4649-a030-049d44f7bb4d tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480" status: 404 len: 111 microversion: 2.1 time: 0.072688 Sep 01 14:07:22.990878 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 435/891] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:22 2022] GET /compute/v2.1/servers/901d0282-c949-4f4d-9f04-7141c3b42480 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:07:23.000294 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-42f1a8d1-9f81-4674-876d-218bea8d8237 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '.version_select at 0x7f1afd521d30>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:23.089165 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-42f1a8d1-9f81-4674-876d-218bea8d8237 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-54805747" status: 202 len: 0 microversion: 2.1 time: 0.097334 Sep 01 14:07:23.090186 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 457/892] 10.222.0.61 () {58 vars in 1215 bytes} [Thu Sep 1 14:07:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-54805747 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:07:23.106962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-103d2d38-9d1f-4162-acca-fdd26e72bbf5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:23.108266 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-103d2d38-9d1f-4162-acca-fdd26e72bbf5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:23.118941 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-103d2d38-9d1f-4162-acca-fdd26e72bbf5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:23.121357 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-103d2d38-9d1f-4162-acca-fdd26e72bbf5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:23.121357 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-103d2d38-9d1f-4162-acca-fdd26e72bbf5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:23.121357 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-103d2d38-9d1f-4162-acca-fdd26e72bbf5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:23.121668 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-103d2d38-9d1f-4162-acca-fdd26e72bbf5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:23.122175 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-103d2d38-9d1f-4162-acca-fdd26e72bbf5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:23.643736 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-103d2d38-9d1f-4162-acca-fdd26e72bbf5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:23.653332 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-103d2d38-9d1f-4162-acca-fdd26e72bbf5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:23.655378 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-103d2d38-9d1f-4162-acca-fdd26e72bbf5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:23.656838 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-103d2d38-9d1f-4162-acca-fdd26e72bbf5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1739 microversion: 2.20 time: 0.559271 Sep 01 14:07:23.672762 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 436/893] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:23 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1739 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:24.680925 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7c56dc08-a0e8-4ac3-be3e-72d83a9f6d04 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:24.682285 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7c56dc08-a0e8-4ac3-be3e-72d83a9f6d04 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:24.690234 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c56dc08-a0e8-4ac3-be3e-72d83a9f6d04 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:24.690974 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c56dc08-a0e8-4ac3-be3e-72d83a9f6d04 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:24.691565 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c56dc08-a0e8-4ac3-be3e-72d83a9f6d04 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:24.692261 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c56dc08-a0e8-4ac3-be3e-72d83a9f6d04 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:24.692759 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c56dc08-a0e8-4ac3-be3e-72d83a9f6d04 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:24.693181 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7c56dc08-a0e8-4ac3-be3e-72d83a9f6d04 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:24.839598 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7c56dc08-a0e8-4ac3-be3e-72d83a9f6d04 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:24.848708 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7c56dc08-a0e8-4ac3-be3e-72d83a9f6d04 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:24.850746 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7c56dc08-a0e8-4ac3-be3e-72d83a9f6d04 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:24.852183 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7c56dc08-a0e8-4ac3-be3e-72d83a9f6d04 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1739 microversion: 2.20 time: 0.175392 Sep 01 14:07:24.852758 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 458/894] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:24 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:25.882596 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9a1282b2-c417-429c-a2c0-4122b234c483 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:25.891156 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9a1282b2-c417-429c-a2c0-4122b234c483 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:25.897112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=58 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:25.902964 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9a1282b2-c417-429c-a2c0-4122b234c483 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:25.903750 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9a1282b2-c417-429c-a2c0-4122b234c483 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:25.904484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9a1282b2-c417-429c-a2c0-4122b234c483 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:25.905445 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9a1282b2-c417-429c-a2c0-4122b234c483 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:25.906190 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9a1282b2-c417-429c-a2c0-4122b234c483 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:25.906929 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9a1282b2-c417-429c-a2c0-4122b234c483 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:26.058525 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9a1282b2-c417-429c-a2c0-4122b234c483 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:26.067282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9a1282b2-c417-429c-a2c0-4122b234c483 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:26.069037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9a1282b2-c417-429c-a2c0-4122b234c483 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:26.070498 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9a1282b2-c417-429c-a2c0-4122b234c483 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1739 microversion: 2.20 time: 0.194260 Sep 01 14:07:26.071575 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 437/895] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:25 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:26.469331 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-faab39f7-9d0e-4925-a919-6e9335091415 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:26.471547 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-faab39f7-9d0e-4925-a919-6e9335091415 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:26.474111 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:26.479447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-faab39f7-9d0e-4925-a919-6e9335091415 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:26.479954 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-faab39f7-9d0e-4925-a919-6e9335091415 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:26.480591 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-faab39f7-9d0e-4925-a919-6e9335091415 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:26.481291 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-faab39f7-9d0e-4925-a919-6e9335091415 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:26.481751 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-faab39f7-9d0e-4925-a919-6e9335091415 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:26.482209 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-faab39f7-9d0e-4925-a919-6e9335091415 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:26.513014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-faab39f7-9d0e-4925-a919-6e9335091415 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047737 Sep 01 14:07:26.513581 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 459/896] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:07:26 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:26.656453 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d915a104-0831-487a-85aa-0eb6d4a14bdd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:26.656937 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d915a104-0831-487a-85aa-0eb6d4a14bdd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:26.663565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d915a104-0831-487a-85aa-0eb6d4a14bdd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:26.664051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d915a104-0831-487a-85aa-0eb6d4a14bdd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:26.664485 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d915a104-0831-487a-85aa-0eb6d4a14bdd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:26.665181 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d915a104-0831-487a-85aa-0eb6d4a14bdd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:26.665644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d915a104-0831-487a-85aa-0eb6d4a14bdd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:26.666095 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d915a104-0831-487a-85aa-0eb6d4a14bdd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:26.695647 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d915a104-0831-487a-85aa-0eb6d4a14bdd tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments/8ecc67e0-9dfc-43a3-befd-8fefe8f2e56b" status: 200 len: 194 microversion: 2.1 time: 0.043086 Sep 01 14:07:26.702231 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 438/897] 10.222.0.61 () {58 vars in 1413 bytes} [Thu Sep 1 14:07:26 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments/8ecc67e0-9dfc-43a3-befd-8fefe8f2e56b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:26.706293 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-593438a2-b95e-45f7-ae51-803d6bbd3184 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:26.706787 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-593438a2-b95e-45f7-ae51-803d6bbd3184 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:26.713892 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-593438a2-b95e-45f7-ae51-803d6bbd3184 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:26.714368 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-593438a2-b95e-45f7-ae51-803d6bbd3184 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:26.714795 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-593438a2-b95e-45f7-ae51-803d6bbd3184 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:26.715476 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-593438a2-b95e-45f7-ae51-803d6bbd3184 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:26.715926 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-593438a2-b95e-45f7-ae51-803d6bbd3184 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:26.716344 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-593438a2-b95e-45f7-ae51-803d6bbd3184 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:26.799474 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-593438a2-b95e-45f7-ae51-803d6bbd3184 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'services' on Instance uuid 119579c0-e191-42e8-876d-54fc2a73f102 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:26.979955 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-593438a2-b95e-45f7-ae51-803d6bbd3184 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments/8ecc67e0-9dfc-43a3-befd-8fefe8f2e56b" status: 202 len: 0 microversion: 2.1 time: 0.277375 Sep 01 14:07:26.985070 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 460/898] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 1 14:07:26 2022] DELETE /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments/8ecc67e0-9dfc-43a3-befd-8fefe8f2e56b => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:07:26.985204 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7e30cc78-0d47-440b-903e-1ea0e4f993c0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:26.985204 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7e30cc78-0d47-440b-903e-1ea0e4f993c0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:26.990447 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7e30cc78-0d47-440b-903e-1ea0e4f993c0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:26.990937 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7e30cc78-0d47-440b-903e-1ea0e4f993c0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:26.991429 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7e30cc78-0d47-440b-903e-1ea0e4f993c0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:26.992168 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7e30cc78-0d47-440b-903e-1ea0e4f993c0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:26.992601 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7e30cc78-0d47-440b-903e-1ea0e4f993c0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:26.993031 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7e30cc78-0d47-440b-903e-1ea0e4f993c0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:27.019588 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7e30cc78-0d47-440b-903e-1ea0e4f993c0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Going to try to terminate instance {{(pid=127812) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:07:27.094032 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-6466eaa6-e7b5-4840-9418-2d682a738635 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:27.094756 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-6466eaa6-e7b5-4840-9418-2d682a738635 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:27.101081 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6466eaa6-e7b5-4840-9418-2d682a738635 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:27.101561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6466eaa6-e7b5-4840-9418-2d682a738635 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:27.102032 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6466eaa6-e7b5-4840-9418-2d682a738635 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:27.102724 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6466eaa6-e7b5-4840-9418-2d682a738635 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:27.103184 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6466eaa6-e7b5-4840-9418-2d682a738635 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:27.103616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6466eaa6-e7b5-4840-9418-2d682a738635 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:27.241532 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-6466eaa6-e7b5-4840-9418-2d682a738635 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:27.249960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-6466eaa6-e7b5-4840-9418-2d682a738635 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:27.251403 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-6466eaa6-e7b5-4840-9418-2d682a738635 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:27.252866 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-6466eaa6-e7b5-4840-9418-2d682a738635 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1739 microversion: 2.20 time: 0.163088 Sep 01 14:07:27.253425 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 461/899] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:27 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:27.327106 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7e30cc78-0d47-440b-903e-1ea0e4f993c0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 204 len: 0 microversion: 2.1 time: 0.347650 Sep 01 14:07:27.327694 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 439/900] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:07:26 2022] DELETE /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:07:27.335917 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e3091aa5-3b9f-46ff-a929-5bcc8d56fac8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:27.336526 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e3091aa5-3b9f-46ff-a929-5bcc8d56fac8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:27.342605 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e3091aa5-3b9f-46ff-a929-5bcc8d56fac8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:27.343107 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e3091aa5-3b9f-46ff-a929-5bcc8d56fac8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:27.343532 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e3091aa5-3b9f-46ff-a929-5bcc8d56fac8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:27.344273 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e3091aa5-3b9f-46ff-a929-5bcc8d56fac8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:27.344734 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e3091aa5-3b9f-46ff-a929-5bcc8d56fac8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:27.345162 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e3091aa5-3b9f-46ff-a929-5bcc8d56fac8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:27.477740 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e3091aa5-3b9f-46ff-a929-5bcc8d56fac8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:27.486495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e3091aa5-3b9f-46ff-a929-5bcc8d56fac8 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1508 microversion: 2.1 time: 0.154399 Sep 01 14:07:27.487066 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 462/901] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:27 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:28.277363 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-455ee406-cef5-4b4d-a8df-28f81498847d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:28.278079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-455ee406-cef5-4b4d-a8df-28f81498847d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:28.284433 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-455ee406-cef5-4b4d-a8df-28f81498847d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:28.284923 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-455ee406-cef5-4b4d-a8df-28f81498847d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:28.285342 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-455ee406-cef5-4b4d-a8df-28f81498847d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:28.286052 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-455ee406-cef5-4b4d-a8df-28f81498847d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:28.286499 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-455ee406-cef5-4b4d-a8df-28f81498847d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:28.286917 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-455ee406-cef5-4b4d-a8df-28f81498847d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:28.416745 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-455ee406-cef5-4b4d-a8df-28f81498847d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:28.424850 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-455ee406-cef5-4b4d-a8df-28f81498847d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:28.426290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-455ee406-cef5-4b4d-a8df-28f81498847d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:28.427446 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-455ee406-cef5-4b4d-a8df-28f81498847d tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1721 microversion: 2.20 time: 0.154389 Sep 01 14:07:28.428007 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 440/902] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:28 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:28.507754 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e93f8434-4569-415c-80cd-d0e9b80da7a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:28.508391 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e93f8434-4569-415c-80cd-d0e9b80da7a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:28.515046 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e93f8434-4569-415c-80cd-d0e9b80da7a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:28.515531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e93f8434-4569-415c-80cd-d0e9b80da7a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:28.515972 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e93f8434-4569-415c-80cd-d0e9b80da7a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:28.516684 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e93f8434-4569-415c-80cd-d0e9b80da7a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:28.517138 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e93f8434-4569-415c-80cd-d0e9b80da7a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:28.517567 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e93f8434-4569-415c-80cd-d0e9b80da7a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:28.648972 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e93f8434-4569-415c-80cd-d0e9b80da7a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:28.656970 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e93f8434-4569-415c-80cd-d0e9b80da7a0 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1508 microversion: 2.1 time: 0.153717 Sep 01 14:07:28.657580 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 463/903] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:28 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:29.450629 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2cb57578-8d79-4663-83a0-594059a05c95 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:29.451158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2cb57578-8d79-4663-83a0-594059a05c95 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:29.457508 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2cb57578-8d79-4663-83a0-594059a05c95 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:29.458024 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2cb57578-8d79-4663-83a0-594059a05c95 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:29.458456 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2cb57578-8d79-4663-83a0-594059a05c95 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:29.459630 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2cb57578-8d79-4663-83a0-594059a05c95 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:29.460078 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2cb57578-8d79-4663-83a0-594059a05c95 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:29.460500 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2cb57578-8d79-4663-83a0-594059a05c95 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:29.591427 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2cb57578-8d79-4663-83a0-594059a05c95 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:29.600227 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2cb57578-8d79-4663-83a0-594059a05c95 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:29.601696 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2cb57578-8d79-4663-83a0-594059a05c95 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:29.602874 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2cb57578-8d79-4663-83a0-594059a05c95 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1721 microversion: 2.20 time: 0.156374 Sep 01 14:07:29.603429 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 441/904] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:29 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:29.677755 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-55f06ac1-343e-4505-a4ef-b21cec6990bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:29.678384 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-55f06ac1-343e-4505-a4ef-b21cec6990bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:29.684734 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55f06ac1-343e-4505-a4ef-b21cec6990bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:29.685227 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55f06ac1-343e-4505-a4ef-b21cec6990bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:29.685651 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55f06ac1-343e-4505-a4ef-b21cec6990bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:29.686363 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55f06ac1-343e-4505-a4ef-b21cec6990bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:29.686817 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55f06ac1-343e-4505-a4ef-b21cec6990bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:29.687241 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55f06ac1-343e-4505-a4ef-b21cec6990bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:29.871147 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-55f06ac1-343e-4505-a4ef-b21cec6990bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:29.879118 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-55f06ac1-343e-4505-a4ef-b21cec6990bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1508 microversion: 2.1 time: 0.205155 Sep 01 14:07:29.879690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 464/905] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:29 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:30.626152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-62249ec5-2d46-4c30-bbd1-77e86a708f74 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:30.626757 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-62249ec5-2d46-4c30-bbd1-77e86a708f74 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:30.633476 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-62249ec5-2d46-4c30-bbd1-77e86a708f74 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:30.634022 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-62249ec5-2d46-4c30-bbd1-77e86a708f74 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:30.634465 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-62249ec5-2d46-4c30-bbd1-77e86a708f74 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:30.635197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-62249ec5-2d46-4c30-bbd1-77e86a708f74 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:30.635632 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-62249ec5-2d46-4c30-bbd1-77e86a708f74 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:30.636059 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-62249ec5-2d46-4c30-bbd1-77e86a708f74 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:30.640459 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:30.900826 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-06ff6d73-a374-4afa-887b-2b44b3575c48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:30.902157 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-06ff6d73-a374-4afa-887b-2b44b3575c48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:30.908771 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06ff6d73-a374-4afa-887b-2b44b3575c48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:30.912811 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06ff6d73-a374-4afa-887b-2b44b3575c48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:30.912811 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06ff6d73-a374-4afa-887b-2b44b3575c48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:30.912811 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06ff6d73-a374-4afa-887b-2b44b3575c48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:30.912811 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06ff6d73-a374-4afa-887b-2b44b3575c48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:30.913216 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-06ff6d73-a374-4afa-887b-2b44b3575c48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:30.937164 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-62249ec5-2d46-4c30-bbd1-77e86a708f74 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:30.946192 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-62249ec5-2d46-4c30-bbd1-77e86a708f74 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:30.947822 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-62249ec5-2d46-4c30-bbd1-77e86a708f74 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:30.949103 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-62249ec5-2d46-4c30-bbd1-77e86a708f74 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1721 microversion: 2.20 time: 0.327054 Sep 01 14:07:30.949670 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 442/906] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:30 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1721 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:31.092165 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-06ff6d73-a374-4afa-887b-2b44b3575c48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:31.100353 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-06ff6d73-a374-4afa-887b-2b44b3575c48 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1508 microversion: 2.1 time: 0.203436 Sep 01 14:07:31.101043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 465/907] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:30 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:31.267468 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-0b5abee1-8d2b-4978-8be7-e573bbe48563 req-16dad8bd-a231-41ad-abf1-8ed3854205cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba", "name": "network-vif-deleted", "tag": "634362b5-0f9b-4d48-aba3-d7ab3ca88dac"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:31.278897 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0b5abee1-8d2b-4978-8be7-e573bbe48563 req-16dad8bd-a231-41ad-abf1-8ed3854205cc service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:31.279694 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0b5abee1-8d2b-4978-8be7-e573bbe48563 req-16dad8bd-a231-41ad-abf1-8ed3854205cc service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:31.280540 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0b5abee1-8d2b-4978-8be7-e573bbe48563 req-16dad8bd-a231-41ad-abf1-8ed3854205cc service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:31.285861 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3c344397-b76f-4fe9-bf67-2b3b4ae3d486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:31.286454 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3c344397-b76f-4fe9-bf67-2b3b4ae3d486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:31.293462 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3c344397-b76f-4fe9-bf67-2b3b4ae3d486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:31.294307 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3c344397-b76f-4fe9-bf67-2b3b4ae3d486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:31.294831 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3c344397-b76f-4fe9-bf67-2b3b4ae3d486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:31.295701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3c344397-b76f-4fe9-bf67-2b3b4ae3d486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:31.296231 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3c344397-b76f-4fe9-bf67-2b3b4ae3d486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:31.296727 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3c344397-b76f-4fe9-bf67-2b3b4ae3d486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:31.297993 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-0b5abee1-8d2b-4978-8be7-e573bbe48563 req-16dad8bd-a231-41ad-abf1-8ed3854205cc service nova] Creating event network-vif-deleted:634362b5-0f9b-4d48-aba3-d7ab3ca88dac for instance 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba on hv-cinder-85221 Sep 01 14:07:31.304109 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-0b5abee1-8d2b-4978-8be7-e573bbe48563 req-16dad8bd-a231-41ad-abf1-8ed3854205cc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041153 Sep 01 14:07:31.304711 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 443/908] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:31.330940 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3c344397-b76f-4fe9-bf67-2b3b4ae3d486 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments/67be0017-8dc7-48e2-bbb5-5717ffe1a606" status: 200 len: 194 microversion: 2.1 time: 0.049020 Sep 01 14:07:31.331546 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 466/909] 10.222.0.61 () {58 vars in 1413 bytes} [Thu Sep 1 14:07:31 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments/67be0017-8dc7-48e2-bbb5-5717ffe1a606 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:31.342604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-71eb225f-f281-4c37-89f5-9ffcb36f2892 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:31.347494 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-71eb225f-f281-4c37-89f5-9ffcb36f2892 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:31.350014 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-71eb225f-f281-4c37-89f5-9ffcb36f2892 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:31.350504 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-71eb225f-f281-4c37-89f5-9ffcb36f2892 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:31.350939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-71eb225f-f281-4c37-89f5-9ffcb36f2892 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:31.351635 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-71eb225f-f281-4c37-89f5-9ffcb36f2892 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:31.352304 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-71eb225f-f281-4c37-89f5-9ffcb36f2892 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:31.352728 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-71eb225f-f281-4c37-89f5-9ffcb36f2892 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:31.433207 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-71eb225f-f281-4c37-89f5-9ffcb36f2892 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'services' on Instance uuid 119579c0-e191-42e8-876d-54fc2a73f102 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:31.623593 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-71eb225f-f281-4c37-89f5-9ffcb36f2892 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments/67be0017-8dc7-48e2-bbb5-5717ffe1a606" status: 202 len: 0 microversion: 2.1 time: 0.284993 Sep 01 14:07:31.628389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 444/910] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 1 14:07:31 2022] DELETE /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments/67be0017-8dc7-48e2-bbb5-5717ffe1a606 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:07:31.848023 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-79ff2ff7-aae0-483e-86db-da615a2777d9 req-336bc97c-1f79-4bd2-b3d9-61481fe1b8f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacf49fd-7b35-4e19-81f0-098fc9d2b0d6", "name": "network-vif-unplugged", "status": "completed", "tag": "fce10985-ae68-4e7b-beef-fef3f597b453"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:31.858505 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-79ff2ff7-aae0-483e-86db-da615a2777d9 req-336bc97c-1f79-4bd2-b3d9-61481fe1b8f5 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:31.864186 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-79ff2ff7-aae0-483e-86db-da615a2777d9 req-336bc97c-1f79-4bd2-b3d9-61481fe1b8f5 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:31.864186 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-79ff2ff7-aae0-483e-86db-da615a2777d9 req-336bc97c-1f79-4bd2-b3d9-61481fe1b8f5 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:31.871010 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-79ff2ff7-aae0-483e-86db-da615a2777d9 req-336bc97c-1f79-4bd2-b3d9-61481fe1b8f5 service nova] Creating event network-vif-unplugged:fce10985-ae68-4e7b-beef-fef3f597b453 for instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 on hv-cinder-85221 Sep 01 14:07:31.875901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-79ff2ff7-aae0-483e-86db-da615a2777d9 req-336bc97c-1f79-4bd2-b3d9-61481fe1b8f5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031575 Sep 01 14:07:31.876478 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 467/911] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:31.973815 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ecfc5a06-f15d-49ef-a80a-e6e31aa272f3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:31.975550 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ecfc5a06-f15d-49ef-a80a-e6e31aa272f3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:31.981732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecfc5a06-f15d-49ef-a80a-e6e31aa272f3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:31.982251 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecfc5a06-f15d-49ef-a80a-e6e31aa272f3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:31.982708 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecfc5a06-f15d-49ef-a80a-e6e31aa272f3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:31.983403 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecfc5a06-f15d-49ef-a80a-e6e31aa272f3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:31.983849 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecfc5a06-f15d-49ef-a80a-e6e31aa272f3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:31.984269 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ecfc5a06-f15d-49ef-a80a-e6e31aa272f3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:32.116563 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ecfc5a06-f15d-49ef-a80a-e6e31aa272f3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:32.121457 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-682691ff-2b80-412f-b165-6508fa5fc8c3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:32.122187 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-682691ff-2b80-412f-b165-6508fa5fc8c3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:32.124816 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ecfc5a06-f15d-49ef-a80a-e6e31aa272f3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:32.126306 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ecfc5a06-f15d-49ef-a80a-e6e31aa272f3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:32.127732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ecfc5a06-f15d-49ef-a80a-e6e31aa272f3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1721 microversion: 2.20 time: 0.158432 Sep 01 14:07:32.128289 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 445/912] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:31 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:32.128629 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-682691ff-2b80-412f-b165-6508fa5fc8c3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:32.129118 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-682691ff-2b80-412f-b165-6508fa5fc8c3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:32.129581 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-682691ff-2b80-412f-b165-6508fa5fc8c3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:32.130316 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-682691ff-2b80-412f-b165-6508fa5fc8c3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:32.131304 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-682691ff-2b80-412f-b165-6508fa5fc8c3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:32.131721 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-682691ff-2b80-412f-b165-6508fa5fc8c3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:32.197098 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-682691ff-2b80-412f-b165-6508fa5fc8c3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:32.205575 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-682691ff-2b80-412f-b165-6508fa5fc8c3 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1466 microversion: 2.1 time: 0.088823 Sep 01 14:07:32.206403 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 468/913] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:32 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1466 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:33.152512 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-51578e0b-ab66-4cb1-92a3-610e231966a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:33.153586 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-51578e0b-ab66-4cb1-92a3-610e231966a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:33.160981 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-51578e0b-ab66-4cb1-92a3-610e231966a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:33.161481 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-51578e0b-ab66-4cb1-92a3-610e231966a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:33.162116 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-51578e0b-ab66-4cb1-92a3-610e231966a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:33.162854 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-51578e0b-ab66-4cb1-92a3-610e231966a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:33.163313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-51578e0b-ab66-4cb1-92a3-610e231966a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:33.163739 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-51578e0b-ab66-4cb1-92a3-610e231966a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:33.232789 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:33.233645 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:33.240566 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:33.241278 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:33.241519 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:33.242269 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:33.242726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:33.243158 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:33.284379 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:33.285027 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:33.285792 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:33.286346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'fault' on Instance uuid 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:33.324217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-51578e0b-ab66-4cb1-92a3-610e231966a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:33.335057 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-51578e0b-ab66-4cb1-92a3-610e231966a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:33.336544 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-51578e0b-ab66-4cb1-92a3-610e231966a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:33.337737 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-51578e0b-ab66-4cb1-92a3-610e231966a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1721 microversion: 2.20 time: 0.190193 Sep 01 14:07:33.338329 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 446/914] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:33 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:33.344272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:33.353363 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-952cdf56-e9fe-4ac2-b5f0-8c1bf802f2e9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 200 len: 1311 microversion: 2.1 time: 0.124554 Sep 01 14:07:33.354249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 469/915] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:33 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 1311 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:34.361752 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-61512a4c-a0d4-4a64-ace2-0b5b7ba85132 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:34.362380 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-61512a4c-a0d4-4a64-ace2-0b5b7ba85132 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:34.368952 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-61512a4c-a0d4-4a64-ace2-0b5b7ba85132 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.369438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-61512a4c-a0d4-4a64-ace2-0b5b7ba85132 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.369899 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-61512a4c-a0d4-4a64-ace2-0b5b7ba85132 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.370598 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-61512a4c-a0d4-4a64-ace2-0b5b7ba85132 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.371132 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-61512a4c-a0d4-4a64-ace2-0b5b7ba85132 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.371551 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-61512a4c-a0d4-4a64-ace2-0b5b7ba85132 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.376356 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7b86a54a-e18e-4526-9db9-4750610d600b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:34.376971 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7b86a54a-e18e-4526-9db9-4750610d600b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:34.384653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7b86a54a-e18e-4526-9db9-4750610d600b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.385142 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7b86a54a-e18e-4526-9db9-4750610d600b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.385585 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7b86a54a-e18e-4526-9db9-4750610d600b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.386356 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7b86a54a-e18e-4526-9db9-4750610d600b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.387091 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7b86a54a-e18e-4526-9db9-4750610d600b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.387527 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7b86a54a-e18e-4526-9db9-4750610d600b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.404249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-7b86a54a-e18e-4526-9db9-4750610d600b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] HTTP exception thrown: Instance 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba could not be found. Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7b86a54a-e18e-4526-9db9-4750610d600b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Request method failure captured: Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba HTTP/1.1 Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELtodHK0hlU0ssq5VsVzMh6Isxe-uCStXQYmXx3WC5v-cWde1ZtUEz4tBUd99Izqseob2wB5HoMDtngWz9-8nQFIx5OnaExar3GImRdIpuyNt3odGrByyBSZ4Yaf1qZx3OBIwh6RmJIDNKvWbLt58dvpxlaGOkEb_1yXcgptrN7a0EY Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: dce10589b8b240e6829f2e158415a1b8 Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:07:34.405951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:07:34.408280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dce10589b8b240e6829f2e158415a1b8"}]}] Sep 01 14:07:34.408280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:07:34.408280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: dce10589b8b240e6829f2e158415a1b8 Sep 01 14:07:34.408280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:07:34.408280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-ServerRescueNegativeTestJSON-1978503690-project Sep 01 14:07:34.408280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:07:34.408280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:07:34.408280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 65c88d8b86544ab5825adbadb26b1e2e Sep 01 14:07:34.408280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1978503690-project Sep 01 14:07:34.408280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:07:34.408280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba could not be found. Sep 01 14:07:34.408280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba'} Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba could not be found. Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:07:34.409733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba could not be found. Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba could not be found. Sep 01 14:07:34.412931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:34.414522 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7b86a54a-e18e-4526-9db9-4750610d600b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Returning 404 to user: Instance 7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:07:34.414522 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7b86a54a-e18e-4526-9db9-4750610d600b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba" status: 404 len: 111 microversion: 2.1 time: 0.035003 Sep 01 14:07:34.414522 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 470/916] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:34 2022] GET /compute/v2.1/servers/7a1b9ba6-f0a9-4a4c-8572-de6d0f5527ba => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:07:34.420875 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3365045e-b529-44ba-baae-805455ec8f66 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:34.421504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3365045e-b529-44ba-baae-805455ec8f66 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:34.429193 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3365045e-b529-44ba-baae-805455ec8f66 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.435033 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3365045e-b529-44ba-baae-805455ec8f66 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.435033 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3365045e-b529-44ba-baae-805455ec8f66 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.435033 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3365045e-b529-44ba-baae-805455ec8f66 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.435033 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3365045e-b529-44ba-baae-805455ec8f66 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.435467 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3365045e-b529-44ba-baae-805455ec8f66 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.460348 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3365045e-b529-44ba-baae-805455ec8f66 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Going to try to terminate instance {{(pid=127811) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:07:34.522521 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-61512a4c-a0d4-4a64-ace2-0b5b7ba85132 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:34.530753 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-61512a4c-a0d4-4a64-ace2-0b5b7ba85132 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:34.532243 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-61512a4c-a0d4-4a64-ace2-0b5b7ba85132 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:34.533406 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-61512a4c-a0d4-4a64-ace2-0b5b7ba85132 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1724 microversion: 2.20 time: 0.175654 Sep 01 14:07:34.534020 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 447/917] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:34 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:34.555558 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8e826547-641c-4ebb-bf1b-9ac877b00604 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77b8c1ab-98a0-4b33-a2c1-066a0cd889bd"}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:34.558090 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8e826547-641c-4ebb-bf1b-9ac877b00604 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:34.564170 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e826547-641c-4ebb-bf1b-9ac877b00604 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.564664 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e826547-641c-4ebb-bf1b-9ac877b00604 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.572606 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e826547-641c-4ebb-bf1b-9ac877b00604 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.572606 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e826547-641c-4ebb-bf1b-9ac877b00604 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.572606 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e826547-641c-4ebb-bf1b-9ac877b00604 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.572606 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8e826547-641c-4ebb-bf1b-9ac877b00604 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.680759 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3365045e-b529-44ba-baae-805455ec8f66 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 204 len: 0 microversion: 2.1 time: 0.264876 Sep 01 14:07:34.681340 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 471/918] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:07:34 2022] DELETE /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:07:34.689651 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f22b889c-e070-4d03-9acb-986d8ba9fdea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:34.690362 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f22b889c-e070-4d03-9acb-986d8ba9fdea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:34.696879 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f22b889c-e070-4d03-9acb-986d8ba9fdea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.697367 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f22b889c-e070-4d03-9acb-986d8ba9fdea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.697827 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f22b889c-e070-4d03-9acb-986d8ba9fdea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.698511 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f22b889c-e070-4d03-9acb-986d8ba9fdea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.698958 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f22b889c-e070-4d03-9acb-986d8ba9fdea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.699381 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f22b889c-e070-4d03-9acb-986d8ba9fdea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.832823 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f22b889c-e070-4d03-9acb-986d8ba9fdea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:34.835341 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:34.841752 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f22b889c-e070-4d03-9acb-986d8ba9fdea tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.156023 Sep 01 14:07:34.842339 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 472/919] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:34 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:34.923342 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-327e6c84-f422-4db4-bded-7d7a48423c0e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:34.925563 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-327e6c84-f422-4db4-bded-7d7a48423c0e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:34.932713 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-327e6c84-f422-4db4-bded-7d7a48423c0e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.933199 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-327e6c84-f422-4db4-bded-7d7a48423c0e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.933635 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-327e6c84-f422-4db4-bded-7d7a48423c0e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.934361 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-327e6c84-f422-4db4-bded-7d7a48423c0e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:34.934814 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-327e6c84-f422-4db4-bded-7d7a48423c0e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:34.935236 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-327e6c84-f422-4db4-bded-7d7a48423c0e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:34.965662 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-327e6c84-f422-4db4-bded-7d7a48423c0e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046176 Sep 01 14:07:34.966243 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 473/920] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:07:34 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 14:07:35.091499 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ab78df1c-f63e-4699-a985-7ddcec5ea2c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:35.092415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ab78df1c-f63e-4699-a985-7ddcec5ea2c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:35.099137 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab78df1c-f63e-4699-a985-7ddcec5ea2c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:35.100155 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab78df1c-f63e-4699-a985-7ddcec5ea2c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:35.100613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab78df1c-f63e-4699-a985-7ddcec5ea2c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:35.101459 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab78df1c-f63e-4699-a985-7ddcec5ea2c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:35.101936 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab78df1c-f63e-4699-a985-7ddcec5ea2c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:35.102355 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ab78df1c-f63e-4699-a985-7ddcec5ea2c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:35.134099 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ab78df1c-f63e-4699-a985-7ddcec5ea2c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047972 Sep 01 14:07:35.134667 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 474/921] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:07:35 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 14:07:35.196689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8bb15c34-736e-493b-b753-33dc444c98fe tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:35.197195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8bb15c34-736e-493b-b753-33dc444c98fe tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:35.205107 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8bb15c34-736e-493b-b753-33dc444c98fe tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:35.205627 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8bb15c34-736e-493b-b753-33dc444c98fe tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:35.206130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8bb15c34-736e-493b-b753-33dc444c98fe tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:35.206837 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8bb15c34-736e-493b-b753-33dc444c98fe tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:35.207301 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8bb15c34-736e-493b-b753-33dc444c98fe tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:35.207756 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8bb15c34-736e-493b-b753-33dc444c98fe tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:35.234483 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8bb15c34-736e-493b-b753-33dc444c98fe tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Going to try to terminate instance {{(pid=127811) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:07:35.503355 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8e826547-641c-4ebb-bf1b-9ac877b00604 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "POST /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.951684 Sep 01 14:07:35.504160 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 448/922] 10.222.0.61 () {62 vars in 1364 bytes} [Thu Sep 1 14:07:34 2022] POST /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/os-volume_attachments => generated 188 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 14:07:35.543767 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8bb15c34-736e-493b-b753-33dc444c98fe tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 204 len: 0 microversion: 2.1 time: 0.350669 Sep 01 14:07:35.544349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 475/923] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:07:35 2022] DELETE /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:07:35.552824 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7a243f57-5c1b-4aba-b8a4-ab5f6023c0c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:35.553639 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7a243f57-5c1b-4aba-b8a4-ab5f6023c0c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:35.560324 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7a243f57-5c1b-4aba-b8a4-ab5f6023c0c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:35.560815 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7a243f57-5c1b-4aba-b8a4-ab5f6023c0c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:35.561258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7a243f57-5c1b-4aba-b8a4-ab5f6023c0c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:35.561991 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7a243f57-5c1b-4aba-b8a4-ab5f6023c0c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:35.562454 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7a243f57-5c1b-4aba-b8a4-ab5f6023c0c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:35.562884 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7a243f57-5c1b-4aba-b8a4-ab5f6023c0c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:35.630144 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b23d928a-0890-4921-a9eb-e41c6bbd296a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:35.630720 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b23d928a-0890-4921-a9eb-e41c6bbd296a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:35.636965 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b23d928a-0890-4921-a9eb-e41c6bbd296a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:35.637454 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b23d928a-0890-4921-a9eb-e41c6bbd296a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:35.637950 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b23d928a-0890-4921-a9eb-e41c6bbd296a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:35.638682 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b23d928a-0890-4921-a9eb-e41c6bbd296a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:35.639168 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b23d928a-0890-4921-a9eb-e41c6bbd296a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:35.639596 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b23d928a-0890-4921-a9eb-e41c6bbd296a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:35.703709 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7a243f57-5c1b-4aba-b8a4-ab5f6023c0c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:35.712121 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7a243f57-5c1b-4aba-b8a4-ab5f6023c0c1 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1673 microversion: 2.1 time: 0.163175 Sep 01 14:07:35.712715 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 449/924] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:35 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:35.862988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-afffd59a-9b04-408f-ba6c-82886f471667 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:35.863590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-afffd59a-9b04-408f-ba6c-82886f471667 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:35.870382 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-afffd59a-9b04-408f-ba6c-82886f471667 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:35.870872 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-afffd59a-9b04-408f-ba6c-82886f471667 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:35.871310 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-afffd59a-9b04-408f-ba6c-82886f471667 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:35.872012 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-afffd59a-9b04-408f-ba6c-82886f471667 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:35.872474 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-afffd59a-9b04-408f-ba6c-82886f471667 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:35.872897 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-afffd59a-9b04-408f-ba6c-82886f471667 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:36.010666 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-afffd59a-9b04-408f-ba6c-82886f471667 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:36.018685 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-afffd59a-9b04-408f-ba6c-82886f471667 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.159462 Sep 01 14:07:36.019256 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 450/925] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:35 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:36.508432 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b23d928a-0890-4921-a9eb-e41c6bbd296a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/os-volume_attachments/77b8c1ab-98a0-4b33-a2c1-066a0cd889bd" status: 202 len: 0 microversion: 2.20 time: 0.882921 Sep 01 14:07:36.509032 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 476/926] 10.222.0.61 () {60 vars in 1457 bytes} [Thu Sep 1 14:07:35 2022] DELETE /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/os-volume_attachments/77b8c1ab-98a0-4b33-a2c1-066a0cd889bd => generated 0 bytes in 885 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:07:36.568709 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b3f7d374-e75d-4210-a1bb-187db9f005e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:36.569275 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b3f7d374-e75d-4210-a1bb-187db9f005e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:36.575340 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b3f7d374-e75d-4210-a1bb-187db9f005e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:36.575862 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b3f7d374-e75d-4210-a1bb-187db9f005e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:36.576339 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b3f7d374-e75d-4210-a1bb-187db9f005e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:36.577034 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b3f7d374-e75d-4210-a1bb-187db9f005e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:36.577491 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b3f7d374-e75d-4210-a1bb-187db9f005e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:36.577963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b3f7d374-e75d-4210-a1bb-187db9f005e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:36.621413 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b3f7d374-e75d-4210-a1bb-187db9f005e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127812) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 14:07:36.732678 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d2a9cdf1-517b-431e-8484-3ad8608c0bf4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:36.733292 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d2a9cdf1-517b-431e-8484-3ad8608c0bf4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:36.739536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d2a9cdf1-517b-431e-8484-3ad8608c0bf4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:36.740663 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d2a9cdf1-517b-431e-8484-3ad8608c0bf4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:36.741103 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d2a9cdf1-517b-431e-8484-3ad8608c0bf4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:36.741817 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d2a9cdf1-517b-431e-8484-3ad8608c0bf4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:36.742430 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d2a9cdf1-517b-431e-8484-3ad8608c0bf4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:36.742860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d2a9cdf1-517b-431e-8484-3ad8608c0bf4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:36.854849 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b3f7d374-e75d-4210-a1bb-187db9f005e4 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "POST /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/action" status: 202 len: 0 microversion: 2.20 time: 0.290067 Sep 01 14:07:36.856167 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 451/927] 10.222.0.61 () {62 vars in 1319 bytes} [Thu Sep 1 14:07:36 2022] POST /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:07:36.864518 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-14c2af2d-356f-474e-8944-46e54567adba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:36.865724 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-14c2af2d-356f-474e-8944-46e54567adba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:36.872233 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-14c2af2d-356f-474e-8944-46e54567adba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:36.872789 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-14c2af2d-356f-474e-8944-46e54567adba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:36.873237 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-14c2af2d-356f-474e-8944-46e54567adba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:36.873997 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-14c2af2d-356f-474e-8944-46e54567adba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:36.874457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-14c2af2d-356f-474e-8944-46e54567adba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:36.874892 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-14c2af2d-356f-474e-8944-46e54567adba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:36.881028 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d2a9cdf1-517b-431e-8484-3ad8608c0bf4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:36.888738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d2a9cdf1-517b-431e-8484-3ad8608c0bf4 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1673 microversion: 2.1 time: 0.159891 Sep 01 14:07:36.889311 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 477/928] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:36 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:37.013930 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-14c2af2d-356f-474e-8944-46e54567adba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:37.023180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-14c2af2d-356f-474e-8944-46e54567adba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:37.024647 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-14c2af2d-356f-474e-8944-46e54567adba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:37.025852 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-14c2af2d-356f-474e-8944-46e54567adba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1672 microversion: 2.20 time: 0.165632 Sep 01 14:07:37.026450 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 452/929] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:36 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:37.040173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-dad74ef5-7e2f-442d-a0b4-e288979e75cb tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:37.040867 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-dad74ef5-7e2f-442d-a0b4-e288979e75cb tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:37.047004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dad74ef5-7e2f-442d-a0b4-e288979e75cb tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:37.047560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dad74ef5-7e2f-442d-a0b4-e288979e75cb tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:37.048046 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dad74ef5-7e2f-442d-a0b4-e288979e75cb tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:37.048767 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dad74ef5-7e2f-442d-a0b4-e288979e75cb tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:37.049215 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dad74ef5-7e2f-442d-a0b4-e288979e75cb tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:37.049632 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dad74ef5-7e2f-442d-a0b4-e288979e75cb tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:37.185902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-dad74ef5-7e2f-442d-a0b4-e288979e75cb tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:37.194170 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-dad74ef5-7e2f-442d-a0b4-e288979e75cb tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.158381 Sep 01 14:07:37.194741 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 478/930] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:37 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:37.912082 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-db676931-9822-4c0f-a5af-49b814996036 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:37.912670 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-db676931-9822-4c0f-a5af-49b814996036 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:37.918934 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-db676931-9822-4c0f-a5af-49b814996036 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:37.923529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-db676931-9822-4c0f-a5af-49b814996036 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:37.923529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-db676931-9822-4c0f-a5af-49b814996036 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:37.923529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-db676931-9822-4c0f-a5af-49b814996036 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:37.923529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-db676931-9822-4c0f-a5af-49b814996036 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:37.923913 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-db676931-9822-4c0f-a5af-49b814996036 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:38.048743 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3071ec17-14a5-4ec0-a254-555ab3699e08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:38.049967 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3071ec17-14a5-4ec0-a254-555ab3699e08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:38.056666 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3071ec17-14a5-4ec0-a254-555ab3699e08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:38.059729 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-db676931-9822-4c0f-a5af-49b814996036 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:38.063837 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3071ec17-14a5-4ec0-a254-555ab3699e08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:38.064291 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3071ec17-14a5-4ec0-a254-555ab3699e08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:38.065029 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3071ec17-14a5-4ec0-a254-555ab3699e08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:38.065495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3071ec17-14a5-4ec0-a254-555ab3699e08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:38.065960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3071ec17-14a5-4ec0-a254-555ab3699e08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:38.068409 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-db676931-9822-4c0f-a5af-49b814996036 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1673 microversion: 2.1 time: 0.160383 Sep 01 14:07:38.068977 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 453/931] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:37 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:38.200726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3071ec17-14a5-4ec0-a254-555ab3699e08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:38.209035 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3071ec17-14a5-4ec0-a254-555ab3699e08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:38.210531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3071ec17-14a5-4ec0-a254-555ab3699e08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:38.211698 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3071ec17-14a5-4ec0-a254-555ab3699e08 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1672 microversion: 2.20 time: 0.167117 Sep 01 14:07:38.212248 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 479/932] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:38 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:38.215609 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8d63e7bd-5dd0-487b-83ed-3803a9573b6a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:38.220495 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8d63e7bd-5dd0-487b-83ed-3803a9573b6a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:38.222296 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8d63e7bd-5dd0-487b-83ed-3803a9573b6a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:38.222853 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8d63e7bd-5dd0-487b-83ed-3803a9573b6a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:38.223290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8d63e7bd-5dd0-487b-83ed-3803a9573b6a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:38.224010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8d63e7bd-5dd0-487b-83ed-3803a9573b6a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:38.225017 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8d63e7bd-5dd0-487b-83ed-3803a9573b6a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:38.225445 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8d63e7bd-5dd0-487b-83ed-3803a9573b6a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:38.371053 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8d63e7bd-5dd0-487b-83ed-3803a9573b6a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:38.379164 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8d63e7bd-5dd0-487b-83ed-3803a9573b6a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.167438 Sep 01 14:07:38.379734 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 454/933] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:38 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:39.089680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0adfb4da-044f-4986-b944-4e60d758a839 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:39.090313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0adfb4da-044f-4986-b944-4e60d758a839 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:39.096809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0adfb4da-044f-4986-b944-4e60d758a839 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:39.097291 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0adfb4da-044f-4986-b944-4e60d758a839 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:39.097815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0adfb4da-044f-4986-b944-4e60d758a839 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:39.098515 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0adfb4da-044f-4986-b944-4e60d758a839 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:39.099017 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0adfb4da-044f-4986-b944-4e60d758a839 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:39.099535 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0adfb4da-044f-4986-b944-4e60d758a839 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:39.235826 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-abe86953-27e8-4e44-8e60-1953e3884336 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:39.236524 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-abe86953-27e8-4e44-8e60-1953e3884336 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:39.243726 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-abe86953-27e8-4e44-8e60-1953e3884336 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:39.244247 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-abe86953-27e8-4e44-8e60-1953e3884336 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:39.244693 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-abe86953-27e8-4e44-8e60-1953e3884336 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:39.245487 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-abe86953-27e8-4e44-8e60-1953e3884336 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:39.246001 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-abe86953-27e8-4e44-8e60-1953e3884336 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:39.246460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-abe86953-27e8-4e44-8e60-1953e3884336 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:39.250769 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:39.499551 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0adfb4da-044f-4986-b944-4e60d758a839 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:39.510058 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0adfb4da-044f-4986-b944-4e60d758a839 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1673 microversion: 2.1 time: 0.424906 Sep 01 14:07:39.510761 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 480/934] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:39 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1673 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:39.516240 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-995f26b2-120f-4ea1-aaac-0730e3a21980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:39.516992 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-995f26b2-120f-4ea1-aaac-0730e3a21980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:39.524391 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-995f26b2-120f-4ea1-aaac-0730e3a21980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:39.525245 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-995f26b2-120f-4ea1-aaac-0730e3a21980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:39.525794 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-995f26b2-120f-4ea1-aaac-0730e3a21980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:39.526525 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-995f26b2-120f-4ea1-aaac-0730e3a21980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:39.527176 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-995f26b2-120f-4ea1-aaac-0730e3a21980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:39.527658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-995f26b2-120f-4ea1-aaac-0730e3a21980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:39.664789 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-abe86953-27e8-4e44-8e60-1953e3884336 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:39.674219 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-abe86953-27e8-4e44-8e60-1953e3884336 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:39.675875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-abe86953-27e8-4e44-8e60-1953e3884336 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:39.677157 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-abe86953-27e8-4e44-8e60-1953e3884336 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1672 microversion: 2.20 time: 0.445467 Sep 01 14:07:39.679478 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 455/935] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:39 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1672 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:39.878347 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-995f26b2-120f-4ea1-aaac-0730e3a21980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:39.887109 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-995f26b2-120f-4ea1-aaac-0730e3a21980 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1521 microversion: 2.1 time: 0.374864 Sep 01 14:07:39.887678 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 481/936] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:39 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:40.165154 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-359c16a7-ca7d-4b11-91f8-d4da206ed339 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:40.165652 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-359c16a7-ca7d-4b11-91f8-d4da206ed339 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:40.172045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-359c16a7-ca7d-4b11-91f8-d4da206ed339 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.172537 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-359c16a7-ca7d-4b11-91f8-d4da206ed339 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.172966 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-359c16a7-ca7d-4b11-91f8-d4da206ed339 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.173866 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-359c16a7-ca7d-4b11-91f8-d4da206ed339 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.175358 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-359c16a7-ca7d-4b11-91f8-d4da206ed339 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.175790 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-359c16a7-ca7d-4b11-91f8-d4da206ed339 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.203645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-359c16a7-ca7d-4b11-91f8-d4da206ed339 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/ips" status: 200 len: 149 microversion: 2.1 time: 0.042591 Sep 01 14:07:40.204587 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 456/937] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 1 14:07:40 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:40.531773 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f60a82fb-64f0-4f81-93dd-14af5dcb9068 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:40.532365 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f60a82fb-64f0-4f81-93dd-14af5dcb9068 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:40.538976 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f60a82fb-64f0-4f81-93dd-14af5dcb9068 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.539465 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f60a82fb-64f0-4f81-93dd-14af5dcb9068 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.539900 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f60a82fb-64f0-4f81-93dd-14af5dcb9068 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.540679 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f60a82fb-64f0-4f81-93dd-14af5dcb9068 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.541142 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f60a82fb-64f0-4f81-93dd-14af5dcb9068 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.541566 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f60a82fb-64f0-4f81-93dd-14af5dcb9068 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.700403 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-90ecd703-8e46-4cd3-87de-46a536de5236 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:40.701869 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-90ecd703-8e46-4cd3-87de-46a536de5236 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:40.708995 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90ecd703-8e46-4cd3-87de-46a536de5236 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.709493 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90ecd703-8e46-4cd3-87de-46a536de5236 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.710008 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90ecd703-8e46-4cd3-87de-46a536de5236 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.711528 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90ecd703-8e46-4cd3-87de-46a536de5236 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.712101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90ecd703-8e46-4cd3-87de-46a536de5236 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.712550 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90ecd703-8e46-4cd3-87de-46a536de5236 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.899071 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f60a82fb-64f0-4f81-93dd-14af5dcb9068 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:40.907759 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f60a82fb-64f0-4f81-93dd-14af5dcb9068 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1673 microversion: 2.1 time: 0.379801 Sep 01 14:07:40.908438 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 482/938] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:40 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1673 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:40.913175 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-1fa5bc17-2aad-4b72-9bba-691547747447 req-fee2fb31-5e10-4faf-919c-2c89e2e2647e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b03c776a-6615-43a6-88bd-58efe9736c7f", "name": "network-vif-deleted", "tag": "4ec69dd1-60c6-4360-ac7d-4b40a6b43577"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:40.922872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-1fa5bc17-2aad-4b72-9bba-691547747447 req-fee2fb31-5e10-4faf-919c-2c89e2e2647e service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.923608 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-1fa5bc17-2aad-4b72-9bba-691547747447 req-fee2fb31-5e10-4faf-919c-2c89e2e2647e service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.924046 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-1fa5bc17-2aad-4b72-9bba-691547747447 req-fee2fb31-5e10-4faf-919c-2c89e2e2647e service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.936235 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-1fa5bc17-2aad-4b72-9bba-691547747447 req-fee2fb31-5e10-4faf-919c-2c89e2e2647e service nova] Creating event network-vif-deleted:4ec69dd1-60c6-4360-ac7d-4b40a6b43577 for instance b03c776a-6615-43a6-88bd-58efe9736c7f on hv-cinder-85221 Sep 01 14:07:40.943730 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-1fa5bc17-2aad-4b72-9bba-691547747447 req-fee2fb31-5e10-4faf-919c-2c89e2e2647e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033278 Sep 01 14:07:40.944351 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 483/939] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:40.949528 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-07302da0-f640-45da-9740-8cd2674a0b01 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:40.950128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-90ecd703-8e46-4cd3-87de-46a536de5236 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:40.950333 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-07302da0-f640-45da-9740-8cd2674a0b01 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:40.957080 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-07302da0-f640-45da-9740-8cd2674a0b01 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.957584 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-07302da0-f640-45da-9740-8cd2674a0b01 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.958060 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-07302da0-f640-45da-9740-8cd2674a0b01 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.958818 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-07302da0-f640-45da-9740-8cd2674a0b01 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:40.959272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-07302da0-f640-45da-9740-8cd2674a0b01 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:40.959698 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-07302da0-f640-45da-9740-8cd2674a0b01 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:40.966123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-90ecd703-8e46-4cd3-87de-46a536de5236 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:40.967585 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-90ecd703-8e46-4cd3-87de-46a536de5236 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:40.973597 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-90ecd703-8e46-4cd3-87de-46a536de5236 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.276993 Sep 01 14:07:40.974279 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 457/940] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:40 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:41.070588 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-07302da0-f640-45da-9740-8cd2674a0b01 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:41.110426 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-07302da0-f640-45da-9740-8cd2674a0b01 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1479 microversion: 2.1 time: 0.163420 Sep 01 14:07:41.112445 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 484/941] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:40 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1479 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:41.930348 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:41.930984 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:41.938016 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:41.938502 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:41.938937 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:41.939908 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:41.940440 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:41.941081 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:41.972677 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:41.973172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:41.973617 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:41.974597 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'fault' on Instance uuid 119579c0-e191-42e8-876d-54fc2a73f102 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:41.997173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b5974012-4881-4a50-b77f-ae4209063584 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:41.997893 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-b5974012-4881-4a50-b77f-ae4209063584 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:42.004957 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b5974012-4881-4a50-b77f-ae4209063584 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:42.005494 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b5974012-4881-4a50-b77f-ae4209063584 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:42.005974 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b5974012-4881-4a50-b77f-ae4209063584 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:42.006683 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b5974012-4881-4a50-b77f-ae4209063584 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:42.007140 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b5974012-4881-4a50-b77f-ae4209063584 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:42.007761 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-b5974012-4881-4a50-b77f-ae4209063584 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:42.021350 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:42.032786 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f7a19203-f28d-4b3d-8246-7bb713a69b4c tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1327 microversion: 2.1 time: 0.106759 Sep 01 14:07:42.033570 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 458/942] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:41 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:42.134722 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:42.135397 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:42.147547 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:42.151050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:42.153024 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:42.156986 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:42.159345 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:42.160229 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:42.243240 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:42.244432 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:42.245116 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:42.245620 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'fault' on Instance uuid b03c776a-6615-43a6-88bd-58efe9736c7f {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:42.276528 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-b5974012-4881-4a50-b77f-ae4209063584 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:42.283745 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:42.289394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-b5974012-4881-4a50-b77f-ae4209063584 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:42.290744 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-b5974012-4881-4a50-b77f-ae4209063584 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:42.303137 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b5974012-4881-4a50-b77f-ae4209063584 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.309266 Sep 01 14:07:42.304247 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 485/943] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:41 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:42.363952 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1a8690fc-f3a6-42f8-a07a-716ab0178eee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c26299b0-fd68-478e-b073-f861e33a54a0"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:42.363952 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1a8690fc-f3a6-42f8-a07a-716ab0178eee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:42.378094 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1a8690fc-f3a6-42f8-a07a-716ab0178eee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:42.378283 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:42.378958 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1a8690fc-f3a6-42f8-a07a-716ab0178eee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:42.379564 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1a8690fc-f3a6-42f8-a07a-716ab0178eee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:42.381006 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1a8690fc-f3a6-42f8-a07a-716ab0178eee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:42.381889 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1a8690fc-f3a6-42f8-a07a-716ab0178eee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:42.382746 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1a8690fc-f3a6-42f8-a07a-716ab0178eee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:42.398261 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-12bb70c6-cd58-4bdd-8187-4a156fed7f89 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1311 microversion: 2.1 time: 0.266107 Sep 01 14:07:42.398261 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 459/944] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:42 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1311 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:42.967602 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-a5013360-bd8f-41c0-9a66-36f87ef130d1 req-c80f7e9d-9ff5-47a1-8e72-84011f877c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119579c0-e191-42e8-876d-54fc2a73f102", "name": "network-vif-deleted", "tag": "96d39b33-549c-4d2d-98ef-d9a4984b2a6d"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:42.977627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-a5013360-bd8f-41c0-9a66-36f87ef130d1 req-c80f7e9d-9ff5-47a1-8e72-84011f877c2b service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:42.978134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-a5013360-bd8f-41c0-9a66-36f87ef130d1 req-c80f7e9d-9ff5-47a1-8e72-84011f877c2b service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:42.978924 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-a5013360-bd8f-41c0-9a66-36f87ef130d1 req-c80f7e9d-9ff5-47a1-8e72-84011f877c2b service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.006741 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-a5013360-bd8f-41c0-9a66-36f87ef130d1 req-c80f7e9d-9ff5-47a1-8e72-84011f877c2b service nova] Creating event network-vif-deleted:96d39b33-549c-4d2d-98ef-d9a4984b2a6d for instance 119579c0-e191-42e8-876d-54fc2a73f102 on hv-cinder-85221 Sep 01 14:07:43.011896 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-a5013360-bd8f-41c0-9a66-36f87ef130d1 req-c80f7e9d-9ff5-47a1-8e72-84011f877c2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047979 Sep 01 14:07:43.012584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 460/945] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:07:43.055908 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:43.056607 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:43.062858 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.063348 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.063788 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.064489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.064943 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.065367 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.100101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.100720 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.101226 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.101750 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'fault' on Instance uuid 119579c0-e191-42e8-876d-54fc2a73f102 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:43.152277 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:43.160929 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-fec7a414-0251-42d4-b6b0-e46bd8c2a93b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1327 microversion: 2.1 time: 0.109669 Sep 01 14:07:43.162068 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 461/946] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:43 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1327 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:43.327846 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-79db61ae-4676-451f-93d1-8ed15ce680a0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:43.328448 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-79db61ae-4676-451f-93d1-8ed15ce680a0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:43.343914 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79db61ae-4676-451f-93d1-8ed15ce680a0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.344694 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79db61ae-4676-451f-93d1-8ed15ce680a0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.345304 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79db61ae-4676-451f-93d1-8ed15ce680a0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.346288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79db61ae-4676-451f-93d1-8ed15ce680a0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.346912 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79db61ae-4676-451f-93d1-8ed15ce680a0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.347671 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79db61ae-4676-451f-93d1-8ed15ce680a0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.516331 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-79db61ae-4676-451f-93d1-8ed15ce680a0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:43.525082 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-79db61ae-4676-451f-93d1-8ed15ce680a0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:43.526546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-79db61ae-4676-451f-93d1-8ed15ce680a0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:43.527739 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-79db61ae-4676-451f-93d1-8ed15ce680a0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.204054 Sep 01 14:07:43.528293 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 462/947] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:43 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:43.533530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:43.534161 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:43.541407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.541945 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.542418 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.543138 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.543595 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.544026 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.588101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:43.588939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:43.589618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:43.590360 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'fault' on Instance uuid b03c776a-6615-43a6-88bd-58efe9736c7f {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:43.635021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:43.644618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3fc9f799-e62f-4fe3-baf5-e66d7f270974 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1311 microversion: 2.1 time: 0.114796 Sep 01 14:07:43.645721 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 463/948] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:43 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:44.183374 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:44.190529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:44.191248 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.192188 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.193325 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:44.194257 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.194718 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.195146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:44.233088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.233618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.234088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:44.234536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'fault' on Instance uuid 119579c0-e191-42e8-876d-54fc2a73f102 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:44.277280 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:44.285365 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d0951da4-8b11-4692-996f-306da29b6644 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1327 microversion: 2.1 time: 0.106297 Sep 01 14:07:44.286037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 464/949] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:44 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:44.551629 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-bf712d1d-b48b-4a2b-95b2-da30670b66d5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:44.552295 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-bf712d1d-b48b-4a2b-95b2-da30670b66d5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:44.558613 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf712d1d-b48b-4a2b-95b2-da30670b66d5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.559182 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf712d1d-b48b-4a2b-95b2-da30670b66d5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.559695 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf712d1d-b48b-4a2b-95b2-da30670b66d5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:44.560476 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf712d1d-b48b-4a2b-95b2-da30670b66d5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.561003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf712d1d-b48b-4a2b-95b2-da30670b66d5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.561522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf712d1d-b48b-4a2b-95b2-da30670b66d5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:44.706265 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-bf712d1d-b48b-4a2b-95b2-da30670b66d5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:44.716093 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-bf712d1d-b48b-4a2b-95b2-da30670b66d5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:44.717679 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-bf712d1d-b48b-4a2b-95b2-da30670b66d5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:44.718958 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-bf712d1d-b48b-4a2b-95b2-da30670b66d5 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.171362 Sep 01 14:07:44.719608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 465/950] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:44 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:44.724062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:44.725340 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:44.736190 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.736686 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.737503 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:44.738302 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.738861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.739371 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:44.783541 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:44.784026 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:44.784462 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:44.784906 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'fault' on Instance uuid b03c776a-6615-43a6-88bd-58efe9736c7f {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:44.836458 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:44.844484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-28a56d91-1079-42d5-809a-4b5b63281b57 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1311 microversion: 2.1 time: 0.123831 Sep 01 14:07:44.845076 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 466/951] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:44 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1311 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:45.306621 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:45.310287 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:45.322110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:45.322782 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:45.323310 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:45.324113 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:45.324671 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:45.325220 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:45.357761 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:45.358364 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:45.358874 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:45.359397 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'fault' on Instance uuid 119579c0-e191-42e8-876d-54fc2a73f102 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:45.403084 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:45.412977 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ee33fad6-6e52-4eb8-b5f7-977c97c452fc tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1327 microversion: 2.1 time: 0.110746 Sep 01 14:07:45.414639 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 467/952] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:45 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:45.744220 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-582178b6-b97b-4634-a64f-a675e72303c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:45.744825 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-582178b6-b97b-4634-a64f-a675e72303c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:45.750939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-582178b6-b97b-4634-a64f-a675e72303c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:45.751424 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-582178b6-b97b-4634-a64f-a675e72303c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:45.751862 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-582178b6-b97b-4634-a64f-a675e72303c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:45.752820 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-582178b6-b97b-4634-a64f-a675e72303c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:45.753274 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-582178b6-b97b-4634-a64f-a675e72303c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:45.753698 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-582178b6-b97b-4634-a64f-a675e72303c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:45.899576 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-582178b6-b97b-4634-a64f-a675e72303c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:45.910960 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-582178b6-b97b-4634-a64f-a675e72303c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:45.913003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-582178b6-b97b-4634-a64f-a675e72303c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:45.914234 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-582178b6-b97b-4634-a64f-a675e72303c3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.175036 Sep 01 14:07:45.914989 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 468/953] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:45 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:45.919243 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:45.919845 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:45.925974 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:45.926464 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:45.926901 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:45.927675 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:45.928111 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:45.928537 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:45.963692 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:45.964176 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:45.964623 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:45.965062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'fault' on Instance uuid b03c776a-6615-43a6-88bd-58efe9736c7f {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:46.008997 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:46.016870 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-031c6035-4872-4af7-994f-81a8e1dedc16 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1311 microversion: 2.1 time: 0.101077 Sep 01 14:07:46.017443 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 469/954] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:45 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:46.435035 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:46.435712 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:46.443460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:46.443683 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:46.444133 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:46.444858 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:46.445315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:46.445757 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:46.477211 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:46.489093 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:46.489635 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:46.490108 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:46.500182 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'fault' on Instance uuid 119579c0-e191-42e8-876d-54fc2a73f102 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:46.534068 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:46.541741 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ae89af18-e2ca-49cd-86ce-24ec669d1822 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1327 microversion: 2.1 time: 0.110882 Sep 01 14:07:46.542333 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 470/955] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:46 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:46.936491 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-91fd8dc3-6aea-478b-9b9f-193a1fb4464a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:46.937087 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-91fd8dc3-6aea-478b-9b9f-193a1fb4464a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:46.943321 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91fd8dc3-6aea-478b-9b9f-193a1fb4464a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:46.943818 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91fd8dc3-6aea-478b-9b9f-193a1fb4464a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:46.944259 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91fd8dc3-6aea-478b-9b9f-193a1fb4464a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:46.944969 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91fd8dc3-6aea-478b-9b9f-193a1fb4464a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:46.945428 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91fd8dc3-6aea-478b-9b9f-193a1fb4464a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:46.945889 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-91fd8dc3-6aea-478b-9b9f-193a1fb4464a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:47.086792 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-91fd8dc3-6aea-478b-9b9f-193a1fb4464a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:47.095061 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-91fd8dc3-6aea-478b-9b9f-193a1fb4464a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:47.096553 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-91fd8dc3-6aea-478b-9b9f-193a1fb4464a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:47.097719 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-91fd8dc3-6aea-478b-9b9f-193a1fb4464a tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.165187 Sep 01 14:07:47.098307 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 471/956] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:46 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:47.102624 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:47.103226 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:47.105923 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:47.109221 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:47.109714 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:47.110204 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:47.110904 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:47.111361 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:47.111824 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:47.149845 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:47.150304 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:47.150749 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:47.151207 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'fault' on Instance uuid b03c776a-6615-43a6-88bd-58efe9736c7f {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:47.196998 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:47.204936 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-81fc040a-f142-49d1-8494-0f285bf683bd tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1311 microversion: 2.1 time: 0.105678 Sep 01 14:07:47.205508 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 472/957] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:47 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:47.563229 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:47.563904 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:47.571446 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:47.571947 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:47.572386 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:47.573092 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:47.573546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:47.574010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:47.606389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:47.606869 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:47.607322 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:47.607761 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'fault' on Instance uuid 119579c0-e191-42e8-876d-54fc2a73f102 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:47.649953 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:47.659096 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4813c2ab-54a0-482a-b5fd-2ce9fff86663 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1327 microversion: 2.1 time: 0.100162 Sep 01 14:07:47.665736 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 473/958] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:47 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:48.120010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-170d6f98-0a68-4fc6-acb0-290bd204ddc3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:48.120628 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-170d6f98-0a68-4fc6-acb0-290bd204ddc3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:48.126695 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-170d6f98-0a68-4fc6-acb0-290bd204ddc3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:48.127179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-170d6f98-0a68-4fc6-acb0-290bd204ddc3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:48.127879 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-170d6f98-0a68-4fc6-acb0-290bd204ddc3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:48.128642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-170d6f98-0a68-4fc6-acb0-290bd204ddc3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:48.129147 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-170d6f98-0a68-4fc6-acb0-290bd204ddc3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:48.129587 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-170d6f98-0a68-4fc6-acb0-290bd204ddc3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:48.284307 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-170d6f98-0a68-4fc6-acb0-290bd204ddc3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:48.293222 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-170d6f98-0a68-4fc6-acb0-290bd204ddc3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:48.294731 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-170d6f98-0a68-4fc6-acb0-290bd204ddc3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:48.295902 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-170d6f98-0a68-4fc6-acb0-290bd204ddc3 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.179791 Sep 01 14:07:48.296465 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 474/959] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:48 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:48.301001 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:48.301602 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:48.310586 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:48.311097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:48.311545 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:48.312330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:48.312802 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:48.313237 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:48.351902 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:48.352442 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:48.354355 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:48.355173 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'fault' on Instance uuid b03c776a-6615-43a6-88bd-58efe9736c7f {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:48.402019 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:48.410211 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a302a140-edd6-4a98-a13e-6e8e96a98ef5 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1311 microversion: 2.1 time: 0.112711 Sep 01 14:07:48.410873 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 475/960] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:48 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:48.681301 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:48.682030 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:48.688260 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:48.688738 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:48.689169 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:48.689914 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:48.690365 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:48.690783 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:48.721536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:48.722039 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:48.722473 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:48.722926 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'fault' on Instance uuid 119579c0-e191-42e8-876d-54fc2a73f102 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:48.771228 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:48.779494 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c29f3f7f-15de-4b08-a160-ee103d0d42a6 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1327 microversion: 2.1 time: 0.102635 Sep 01 14:07:48.780079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 476/961] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:48 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:49.321449 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a0863e94-813d-4cf1-bdc1-62c185936401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:49.322171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a0863e94-813d-4cf1-bdc1-62c185936401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:49.334816 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a0863e94-813d-4cf1-bdc1-62c185936401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:49.335902 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a0863e94-813d-4cf1-bdc1-62c185936401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:49.338751 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a0863e94-813d-4cf1-bdc1-62c185936401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:49.340104 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a0863e94-813d-4cf1-bdc1-62c185936401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:49.340785 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a0863e94-813d-4cf1-bdc1-62c185936401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:49.341534 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a0863e94-813d-4cf1-bdc1-62c185936401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:49.500651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a0863e94-813d-4cf1-bdc1-62c185936401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:49.516527 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a0863e94-813d-4cf1-bdc1-62c185936401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:49.519087 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a0863e94-813d-4cf1-bdc1-62c185936401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:49.520705 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a0863e94-813d-4cf1-bdc1-62c185936401 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.203173 Sep 01 14:07:49.523670 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 477/962] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:49 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:49.543458 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:49.544000 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:49.551851 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:49.553469 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:49.554903 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:49.555622 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:49.556128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:49.556782 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:49.594346 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:49.595610 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:49.596087 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:49.596533 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'fault' on Instance uuid b03c776a-6615-43a6-88bd-58efe9736c7f {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:49.651885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:49.663575 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ef7a464d-0bb9-482e-a78d-72285da5792a tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1311 microversion: 2.1 time: 0.138271 Sep 01 14:07:49.664522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 478/963] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:49 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1311 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:49.800810 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:49.801524 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:49.808798 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:49.809297 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:49.809732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:49.810463 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:49.810913 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:49.811337 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:49.848257 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:49.848666 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:49.849684 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:49.850154 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'fault' on Instance uuid 119579c0-e191-42e8-876d-54fc2a73f102 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:49.903347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:49.913260 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-74c0eb77-7de8-474d-adac-7456fb1b63a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1327 microversion: 2.1 time: 0.116562 Sep 01 14:07:49.914479 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 479/964] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:49 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:50.546522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-49b06e17-4635-4cbc-a759-d89fe45bb2ba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:50.547146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-49b06e17-4635-4cbc-a759-d89fe45bb2ba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:50.553695 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-49b06e17-4635-4cbc-a759-d89fe45bb2ba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.554211 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-49b06e17-4635-4cbc-a759-d89fe45bb2ba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.554652 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-49b06e17-4635-4cbc-a759-d89fe45bb2ba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.555334 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-49b06e17-4635-4cbc-a759-d89fe45bb2ba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.555783 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-49b06e17-4635-4cbc-a759-d89fe45bb2ba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.556202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-49b06e17-4635-4cbc-a759-d89fe45bb2ba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.686198 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-49b06e17-4635-4cbc-a759-d89fe45bb2ba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:50.694894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-49b06e17-4635-4cbc-a759-d89fe45bb2ba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:50.696340 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-49b06e17-4635-4cbc-a759-d89fe45bb2ba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:50.697457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-49b06e17-4635-4cbc-a759-d89fe45bb2ba tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.154858 Sep 01 14:07:50.698036 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 480/965] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:50 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:50.702294 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:50.702887 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:50.708535 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.709014 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.709501 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.710227 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.710678 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.711131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.743563 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.744036 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.744468 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.744914 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'fault' on Instance uuid b03c776a-6615-43a6-88bd-58efe9736c7f {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:50.785645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:50.793867 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-85d6ae01-3f97-4833-bdd4-6e652f5e8584 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1311 microversion: 2.1 time: 0.094865 Sep 01 14:07:50.794465 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 481/966] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:50 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:50.936657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:50.937262 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:50.944193 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.944799 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.945344 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.946209 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.946804 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.947341 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.979388 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:50.979868 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:50.980312 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:50.980862 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'fault' on Instance uuid 119579c0-e191-42e8-876d-54fc2a73f102 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:51.023163 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:51.031237 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3b94ebe3-6dbd-4df3-b44b-4d95bd6dd86b tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1327 microversion: 2.1 time: 0.098581 Sep 01 14:07:51.031833 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 482/967] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:50 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:07:51.720649 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-20980d15-1690-4a02-9b17-0ec5c45c6b28 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:51.721190 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-20980d15-1690-4a02-9b17-0ec5c45c6b28 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:51.727105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-20980d15-1690-4a02-9b17-0ec5c45c6b28 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:51.727583 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-20980d15-1690-4a02-9b17-0ec5c45c6b28 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:51.728014 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-20980d15-1690-4a02-9b17-0ec5c45c6b28 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:51.728697 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-20980d15-1690-4a02-9b17-0ec5c45c6b28 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:51.729193 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-20980d15-1690-4a02-9b17-0ec5c45c6b28 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:51.729612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-20980d15-1690-4a02-9b17-0ec5c45c6b28 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:51.865135 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-20980d15-1690-4a02-9b17-0ec5c45c6b28 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:51.868637 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:51.873702 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-20980d15-1690-4a02-9b17-0ec5c45c6b28 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:51.875168 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-20980d15-1690-4a02-9b17-0ec5c45c6b28 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:51.876323 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-20980d15-1690-4a02-9b17-0ec5c45c6b28 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.159674 Sep 01 14:07:51.876873 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 483/968] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:51 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:51.882145 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:51.882744 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:51.888484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:51.896202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:51.896202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:51.896202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:51.896202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:51.896593 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:51.921024 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:51.921509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:51.921984 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:51.922430 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'fault' on Instance uuid b03c776a-6615-43a6-88bd-58efe9736c7f {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:51.965457 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:51.982044 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a14fe80b-c9c2-4024-ade3-5bf9d8ed883b tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1311 microversion: 2.1 time: 0.095217 Sep 01 14:07:51.982044 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 484/969] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:51 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:52.057206 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:52.058667 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:52.070958 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:52.070958 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:52.070958 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:52.071663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:52.072010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:52.072623 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:52.130659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:52.131117 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:52.131560 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:52.132044 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lazy-loading 'fault' on Instance uuid 119579c0-e191-42e8-876d-54fc2a73f102 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:52.174272 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1943057b69d342d9b45fc02be9f3d5aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8352a8d484e24264a536b8960dab338f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:52.183176 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-64f36551-e375-4984-8dba-d41f373cf9da tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 200 len: 1327 microversion: 2.1 time: 0.132389 Sep 01 14:07:52.183741 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 485/970] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:52 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 1327 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:52.261699 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1a8690fc-f3a6-42f8-a07a-716ab0178eee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "POST /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.905169 Sep 01 14:07:52.262347 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 486/971] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:07:42 2022] POST /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/os-volume_attachments => generated 194 bytes in 9907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:52.900852 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-35651335-cdd8-4254-ab47-583232c04bf7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:52.906490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-35651335-cdd8-4254-ab47-583232c04bf7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:52.908021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-35651335-cdd8-4254-ab47-583232c04bf7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:52.908510 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-35651335-cdd8-4254-ab47-583232c04bf7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:52.908945 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-35651335-cdd8-4254-ab47-583232c04bf7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:52.909635 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-35651335-cdd8-4254-ab47-583232c04bf7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:52.910125 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-35651335-cdd8-4254-ab47-583232c04bf7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:52.910552 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-35651335-cdd8-4254-ab47-583232c04bf7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:52.996326 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:52.997148 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:52.999767 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:07:53.005991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:53.006536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:53.006971 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:53.007671 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:53.008125 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:53.008676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:53.041696 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:53.042235 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:53.042889 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:53.043351 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lazy-loading 'fault' on Instance uuid b03c776a-6615-43a6-88bd-58efe9736c7f {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:07:53.050396 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-35651335-cdd8-4254-ab47-583232c04bf7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:53.059381 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-35651335-cdd8-4254-ab47-583232c04bf7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:53.060877 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-35651335-cdd8-4254-ab47-583232c04bf7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:53.062088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-35651335-cdd8-4254-ab47-583232c04bf7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.166178 Sep 01 14:07:53.062649 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 486/972] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:52 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:53.086949 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c88d8b86544ab5825adbadb26b1e2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce10589b8b240e6829f2e158415a1b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:53.093934 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e7be8e88-50c9-4a19-a427-6eb62e08e120 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 200 len: 1311 microversion: 2.1 time: 0.104082 Sep 01 14:07:53.094490 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 487/973] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:52 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:07:53.204743 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f6a4f0bb-4070-4aa0-a5aa-ec7fdb7fef14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:53.205273 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f6a4f0bb-4070-4aa0-a5aa-ec7fdb7fef14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:53.212197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f6a4f0bb-4070-4aa0-a5aa-ec7fdb7fef14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:53.212658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f6a4f0bb-4070-4aa0-a5aa-ec7fdb7fef14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:53.213087 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f6a4f0bb-4070-4aa0-a5aa-ec7fdb7fef14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:53.213806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f6a4f0bb-4070-4aa0-a5aa-ec7fdb7fef14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:53.214344 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f6a4f0bb-4070-4aa0-a5aa-ec7fdb7fef14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:53.214802 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f6a4f0bb-4070-4aa0-a5aa-ec7fdb7fef14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:53.229385 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-f6a4f0bb-4070-4aa0-a5aa-ec7fdb7fef14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] HTTP exception thrown: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f6a4f0bb-4070-4aa0-a5aa-ec7fdb7fef14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Request method failure captured: Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 HTTP/1.1 Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsNoDTHn4-FKCM-pw08haUU-18wBooHgKYDMZ9YT7YD_3cF7BnnsRI00kcocU6uEn6J_TPzKwIQMuiRAjJyt0Gw1eMAbBj8EfX1TPGQOLVDEfaFSRLk8-k8JoGE04xzyk--FLOLi2mGlQRnequ-h-k77WoQbj4sSFOHwt4Huzc6W7g Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 8352a8d484e24264a536b8960dab338f Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:07:53.237905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:07:53.239565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8352a8d484e24264a536b8960dab338f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8352a8d484e24264a536b8960dab338f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8352a8d484e24264a536b8960dab338f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8352a8d484e24264a536b8960dab338f"}]}] Sep 01 14:07:53.239565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:53.239565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 8352a8d484e24264a536b8960dab338f Sep 01 14:07:53.239565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:53.239565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-AttachVolumeTestJSON-547809350-project Sep 01 14:07:53.239565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:07:53.239565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:07:53.239565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 1943057b69d342d9b45fc02be9f3d5aa Sep 01 14:07:53.239565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-AttachVolumeTestJSON-547809350-project Sep 01 14:07:53.239565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:07:53.239565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:53.239565 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '119579c0-e191-42e8-876d-54fc2a73f102'} Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:07:53.240530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:53.242097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:53.243589 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f6a4f0bb-4070-4aa0-a5aa-ec7fdb7fef14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Returning 404 to user: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:07:53.243589 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f6a4f0bb-4070-4aa0-a5aa-ec7fdb7fef14 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 404 len: 111 microversion: 2.1 time: 0.031874 Sep 01 14:07:53.243589 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 487/974] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:53 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:07:53.243945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0dd1d8bc-5da1-4c86-b1c0-9176288b0e81 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '.version_select at 0x7f1b00cc10d0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:53.390655 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0dd1d8bc-5da1-4c86-b1c0-9176288b0e81 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-188355312" status: 202 len: 0 microversion: 2.1 time: 0.152826 Sep 01 14:07:53.391295 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 488/975] 10.222.0.61 () {58 vars in 1218 bytes} [Thu Sep 1 14:07:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-188355312 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:07:54.085621 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-dc7a1d43-00b0-4353-b392-430bddc2b759 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:54.086885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-dc7a1d43-00b0-4353-b392-430bddc2b759 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:54.094545 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc7a1d43-00b0-4353-b392-430bddc2b759 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:54.095745 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc7a1d43-00b0-4353-b392-430bddc2b759 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:54.095745 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc7a1d43-00b0-4353-b392-430bddc2b759 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:54.096296 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc7a1d43-00b0-4353-b392-430bddc2b759 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:54.096758 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc7a1d43-00b0-4353-b392-430bddc2b759 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:54.097188 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc7a1d43-00b0-4353-b392-430bddc2b759 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:54.116108 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9aaaada6-31c0-4e88-9398-3fca93dcf8d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:54.117023 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9aaaada6-31c0-4e88-9398-3fca93dcf8d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] [instance: b03c776a-6615-43a6-88bd-58efe9736c7f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:54.126533 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9aaaada6-31c0-4e88-9398-3fca93dcf8d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:54.127949 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9aaaada6-31c0-4e88-9398-3fca93dcf8d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:54.128450 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9aaaada6-31c0-4e88-9398-3fca93dcf8d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:54.129258 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9aaaada6-31c0-4e88-9398-3fca93dcf8d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:54.129720 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9aaaada6-31c0-4e88-9398-3fca93dcf8d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:54.130214 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9aaaada6-31c0-4e88-9398-3fca93dcf8d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-9aaaada6-31c0-4e88-9398-3fca93dcf8d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] HTTP exception thrown: Instance b03c776a-6615-43a6-88bd-58efe9736c7f could not be found. Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9aaaada6-31c0-4e88-9398-3fca93dcf8d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Request method failure captured: Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f HTTP/1.1 Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELtodHK0hlU0ssq5VsVzMh6Isxe-uCStXQYmXx3WC5v-cWde1ZtUEz4tBUd99Izqseob2wB5HoMDtngWz9-8nQFIx5OnaExar3GImRdIpuyNt3odGrByyBSZ4Yaf1qZx3OBIwh6RmJIDNKvWbLt58dvpxlaGOkEb_1yXcgptrN7a0EY Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: dce10589b8b240e6829f2e158415a1b8 Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:07:54.158690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:07:54.160834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/dce10589b8b240e6829f2e158415a1b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_dce10589b8b240e6829f2e158415a1b8"}]}] Sep 01 14:07:54.160834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:07:54.160834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: dce10589b8b240e6829f2e158415a1b8 Sep 01 14:07:54.160834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1978503690 Sep 01 14:07:54.160834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-ServerRescueNegativeTestJSON-1978503690-project Sep 01 14:07:54.160834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:07:54.160834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:07:54.160834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 65c88d8b86544ab5825adbadb26b1e2e Sep 01 14:07:54.160834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1978503690-project Sep 01 14:07:54.160834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:07:54.160834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance b03c776a-6615-43a6-88bd-58efe9736c7f could not be found. Sep 01 14:07:54.160834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': 'b03c776a-6615-43a6-88bd-58efe9736c7f'} Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b03c776a-6615-43a6-88bd-58efe9736c7f could not be found. Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:07:54.162653 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b03c776a-6615-43a6-88bd-58efe9736c7f could not be found. Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b03c776a-6615-43a6-88bd-58efe9736c7f could not be found. Sep 01 14:07:54.164943 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:54.166310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9aaaada6-31c0-4e88-9398-3fca93dcf8d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] Returning 404 to user: Instance b03c776a-6615-43a6-88bd-58efe9736c7f could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:07:54.166310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9aaaada6-31c0-4e88-9398-3fca93dcf8d9 tempest-ServerRescueNegativeTestJSON-1978503690 tempest-ServerRescueNegativeTestJSON-1978503690-project] 10.222.0.61 "GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f" status: 404 len: 111 microversion: 2.1 time: 0.040737 Sep 01 14:07:54.166310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 489/976] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:54 2022] GET /compute/v2.1/servers/b03c776a-6615-43a6-88bd-58efe9736c7f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:07:54.274990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-dc7a1d43-00b0-4353-b392-430bddc2b759 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:54.292190 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-dc7a1d43-00b0-4353-b392-430bddc2b759 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:54.292190 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-dc7a1d43-00b0-4353-b392-430bddc2b759 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:54.292889 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-dc7a1d43-00b0-4353-b392-430bddc2b759 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.211473 Sep 01 14:07:54.293446 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 488/977] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:54 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:55.316347 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ec0b612e-679d-4b22-880a-2466fc514196 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:55.317996 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ec0b612e-679d-4b22-880a-2466fc514196 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:55.324254 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ec0b612e-679d-4b22-880a-2466fc514196 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:55.324800 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ec0b612e-679d-4b22-880a-2466fc514196 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:55.325288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ec0b612e-679d-4b22-880a-2466fc514196 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:55.326029 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ec0b612e-679d-4b22-880a-2466fc514196 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:55.326487 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ec0b612e-679d-4b22-880a-2466fc514196 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:55.326972 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ec0b612e-679d-4b22-880a-2466fc514196 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:55.473752 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ec0b612e-679d-4b22-880a-2466fc514196 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:55.482149 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ec0b612e-679d-4b22-880a-2466fc514196 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:55.483696 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ec0b612e-679d-4b22-880a-2466fc514196 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:55.484891 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ec0b612e-679d-4b22-880a-2466fc514196 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.172686 Sep 01 14:07:55.485458 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 490/978] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:55 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:55.955633 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-e5843ac9-3c8a-42ad-a76f-057c3aa9aae5 req-035c11d1-cb0b-4c84-9942-53b4b24539d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacf49fd-7b35-4e19-81f0-098fc9d2b0d6", "name": "network-vif-plugged", "status": "completed", "tag": "fce10985-ae68-4e7b-beef-fef3f597b453"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:07:55.968619 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-e5843ac9-3c8a-42ad-a76f-057c3aa9aae5 req-035c11d1-cb0b-4c84-9942-53b4b24539d7 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:55.969104 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-e5843ac9-3c8a-42ad-a76f-057c3aa9aae5 req-035c11d1-cb0b-4c84-9942-53b4b24539d7 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:55.969535 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-e5843ac9-3c8a-42ad-a76f-057c3aa9aae5 req-035c11d1-cb0b-4c84-9942-53b4b24539d7 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:55.983932 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-e5843ac9-3c8a-42ad-a76f-057c3aa9aae5 req-035c11d1-cb0b-4c84-9942-53b4b24539d7 service nova] Creating event network-vif-plugged:fce10985-ae68-4e7b-beef-fef3f597b453 for instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 on hv-cinder-85221 Sep 01 14:07:55.994149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-e5843ac9-3c8a-42ad-a76f-057c3aa9aae5 req-035c11d1-cb0b-4c84-9942-53b4b24539d7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038648 Sep 01 14:07:55.994149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 489/979] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:07:56.511695 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-62747ce6-361a-4677-8cf3-7c05d1fef440 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:56.524438 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-62747ce6-361a-4677-8cf3-7c05d1fef440 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:56.525040 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-62747ce6-361a-4677-8cf3-7c05d1fef440 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:56.525981 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-62747ce6-361a-4677-8cf3-7c05d1fef440 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:56.526878 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-62747ce6-361a-4677-8cf3-7c05d1fef440 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:56.528125 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-62747ce6-361a-4677-8cf3-7c05d1fef440 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:56.529195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-62747ce6-361a-4677-8cf3-7c05d1fef440 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:56.530004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-62747ce6-361a-4677-8cf3-7c05d1fef440 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:56.697785 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-62747ce6-361a-4677-8cf3-7c05d1fef440 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:56.706728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-62747ce6-361a-4677-8cf3-7c05d1fef440 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:56.709186 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-62747ce6-361a-4677-8cf3-7c05d1fef440 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:56.710508 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-62747ce6-361a-4677-8cf3-7c05d1fef440 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.206147 Sep 01 14:07:56.722491 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 491/980] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:56 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:07:57.028662 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d98b0c81-2869-4154-9485-a3a500fb80a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:57.029254 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d98b0c81-2869-4154-9485-a3a500fb80a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:57.035478 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d98b0c81-2869-4154-9485-a3a500fb80a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:57.035963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d98b0c81-2869-4154-9485-a3a500fb80a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:57.036466 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d98b0c81-2869-4154-9485-a3a500fb80a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:57.037164 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d98b0c81-2869-4154-9485-a3a500fb80a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:57.037619 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d98b0c81-2869-4154-9485-a3a500fb80a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:57.038078 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d98b0c81-2869-4154-9485-a3a500fb80a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:57.051389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-d98b0c81-2869-4154-9485-a3a500fb80a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] HTTP exception thrown: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d98b0c81-2869-4154-9485-a3a500fb80a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Request method failure captured: Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: DELETE /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 HTTP/1.1 Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsNoDTHn4-FKCM-pw08haUU-18wBooHgKYDMZ9YT7YD_3cF7BnnsRI00kcocU6uEn6J_TPzKwIQMuiRAjJyt0Gw1eMAbBj8EfX1TPGQOLVDEfaFSRLk8-k8JoGE04xzyk--FLOLi2mGlQRnequ-h-k77WoQbj4sSFOHwt4Huzc6W7g Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 8352a8d484e24264a536b8960dab338f Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:07:57.053515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:07:57.055171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8352a8d484e24264a536b8960dab338f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8352a8d484e24264a536b8960dab338f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8352a8d484e24264a536b8960dab338f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8352a8d484e24264a536b8960dab338f"}]}] Sep 01 14:07:57.055171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:57.055171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 8352a8d484e24264a536b8960dab338f Sep 01 14:07:57.055171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:57.055171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-AttachVolumeTestJSON-547809350-project Sep 01 14:07:57.055171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:07:57.055171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:07:57.055171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 1943057b69d342d9b45fc02be9f3d5aa Sep 01 14:07:57.055171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-AttachVolumeTestJSON-547809350-project Sep 01 14:07:57.055171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:07:57.055171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:57.055171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '119579c0-e191-42e8-876d-54fc2a73f102'} Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:07:57.056045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:57.057490 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:57.059036 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d98b0c81-2869-4154-9485-a3a500fb80a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Returning 404 to user: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:07:57.059036 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d98b0c81-2869-4154-9485-a3a500fb80a2 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 404 len: 111 microversion: 2.1 time: 0.031193 Sep 01 14:07:57.059036 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 490/981] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:07:57 2022] DELETE /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:07:57.064860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f6ef7ad9-d1c2-431c-a5ca-f83148f42e4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:57.065471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f6ef7ad9-d1c2-431c-a5ca-f83148f42e4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 119579c0-e191-42e8-876d-54fc2a73f102] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:57.072202 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f6ef7ad9-d1c2-431c-a5ca-f83148f42e4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:57.072690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f6ef7ad9-d1c2-431c-a5ca-f83148f42e4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:57.073135 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f6ef7ad9-d1c2-431c-a5ca-f83148f42e4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:57.073892 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f6ef7ad9-d1c2-431c-a5ca-f83148f42e4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:57.074355 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f6ef7ad9-d1c2-431c-a5ca-f83148f42e4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:57.074781 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f6ef7ad9-d1c2-431c-a5ca-f83148f42e4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:57.088192 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-f6ef7ad9-d1c2-431c-a5ca-f83148f42e4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] HTTP exception thrown: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f6ef7ad9-d1c2-431c-a5ca-f83148f42e4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Request method failure captured: Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 HTTP/1.1 Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsNoDTHn4-FKCM-pw08haUU-18wBooHgKYDMZ9YT7YD_3cF7BnnsRI00kcocU6uEn6J_TPzKwIQMuiRAjJyt0Gw1eMAbBj8EfX1TPGQOLVDEfaFSRLk8-k8JoGE04xzyk--FLOLi2mGlQRnequ-h-k77WoQbj4sSFOHwt4Huzc6W7g Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 8352a8d484e24264a536b8960dab338f Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:07:57.089901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:07:57.091415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8352a8d484e24264a536b8960dab338f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8352a8d484e24264a536b8960dab338f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8352a8d484e24264a536b8960dab338f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8352a8d484e24264a536b8960dab338f"}]}] Sep 01 14:07:57.091415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:57.091415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 8352a8d484e24264a536b8960dab338f Sep 01 14:07:57.091415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:57.091415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-AttachVolumeTestJSON-547809350-project Sep 01 14:07:57.091415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:07:57.091415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:07:57.091415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 1943057b69d342d9b45fc02be9f3d5aa Sep 01 14:07:57.091415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-AttachVolumeTestJSON-547809350-project Sep 01 14:07:57.091415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:07:57.091415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:57.091415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '119579c0-e191-42e8-876d-54fc2a73f102'} Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:07:57.092346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. Sep 01 14:07:57.093828 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:57.095244 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f6ef7ad9-d1c2-431c-a5ca-f83148f42e4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Returning 404 to user: Instance 119579c0-e191-42e8-876d-54fc2a73f102 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:07:57.095244 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f6ef7ad9-d1c2-431c-a5ca-f83148f42e4e tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102" status: 404 len: 111 microversion: 2.1 time: 0.030265 Sep 01 14:07:57.095244 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 492/982] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:57 2022] GET /compute/v2.1/servers/119579c0-e191-42e8-876d-54fc2a73f102 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:07:57.732422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d5431a9c-070f-4d72-adec-30c1d469099f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:57.733031 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d5431a9c-070f-4d72-adec-30c1d469099f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:57.739523 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d5431a9c-070f-4d72-adec-30c1d469099f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:57.754037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d5431a9c-070f-4d72-adec-30c1d469099f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:57.754037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d5431a9c-070f-4d72-adec-30c1d469099f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:57.754037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d5431a9c-070f-4d72-adec-30c1d469099f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:57.754037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d5431a9c-070f-4d72-adec-30c1d469099f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:57.754429 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d5431a9c-070f-4d72-adec-30c1d469099f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:57.878771 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d5431a9c-070f-4d72-adec-30c1d469099f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:57.887420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d5431a9c-070f-4d72-adec-30c1d469099f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:57.888864 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d5431a9c-070f-4d72-adec-30c1d469099f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:57.890043 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d5431a9c-070f-4d72-adec-30c1d469099f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.161537 Sep 01 14:07:57.890603 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 491/983] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:57 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:07:58.533914 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-31149e9d-a788-481d-a923-5571628e5f32 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:58.534415 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-31149e9d-a788-481d-a923-5571628e5f32 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:58.540780 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-31149e9d-a788-481d-a923-5571628e5f32 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:58.541258 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-31149e9d-a788-481d-a923-5571628e5f32 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:58.541802 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-31149e9d-a788-481d-a923-5571628e5f32 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:58.542492 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-31149e9d-a788-481d-a923-5571628e5f32 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:58.542945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-31149e9d-a788-481d-a923-5571628e5f32 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:58.543370 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-31149e9d-a788-481d-a923-5571628e5f32 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:58.557286 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-31149e9d-a788-481d-a923-5571628e5f32 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] HTTP exception thrown: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-31149e9d-a788-481d-a923-5571628e5f32 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Request method failure captured: Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: DELETE /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 HTTP/1.1 Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsNoDTHn4-FKCM-pw08haUU-18wBooHgKYDMZ9YT7YD_3cF7BnnsRI00kcocU6uEn6J_TPzKwIQMuiRAjJyt0Gw1eMAbBj8EfX1TPGQOLVDEfaFSRLk8-k8JoGE04xzyk--FLOLi2mGlQRnequ-h-k77WoQbj4sSFOHwt4Huzc6W7g Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 8352a8d484e24264a536b8960dab338f Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:07:58.558849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:07:58.560471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8352a8d484e24264a536b8960dab338f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8352a8d484e24264a536b8960dab338f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8352a8d484e24264a536b8960dab338f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8352a8d484e24264a536b8960dab338f"}]}] Sep 01 14:07:58.560471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:58.560471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 8352a8d484e24264a536b8960dab338f Sep 01 14:07:58.560471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:58.560471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-AttachVolumeTestJSON-547809350-project Sep 01 14:07:58.560471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:07:58.560471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:07:58.560471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 1943057b69d342d9b45fc02be9f3d5aa Sep 01 14:07:58.560471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-AttachVolumeTestJSON-547809350-project Sep 01 14:07:58.560471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:07:58.560471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:07:58.560471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '95b52d39-e40f-40a7-8bde-3d47790fb1d2'} Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:07:58.561475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:07:58.562994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:07:58.564543 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-31149e9d-a788-481d-a923-5571628e5f32 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Returning 404 to user: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:07:58.564543 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-31149e9d-a788-481d-a923-5571628e5f32 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "DELETE /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 404 len: 111 microversion: 2.1 time: 0.030200 Sep 01 14:07:58.564543 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 493/984] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:07:58 2022] DELETE /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:07:58.569402 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2c70fe76-37c9-42f8-b204-39f7188b1524 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:58.570034 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2c70fe76-37c9-42f8-b204-39f7188b1524 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] [instance: 95b52d39-e40f-40a7-8bde-3d47790fb1d2] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:58.577118 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2c70fe76-37c9-42f8-b204-39f7188b1524 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:58.577605 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2c70fe76-37c9-42f8-b204-39f7188b1524 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:58.578089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2c70fe76-37c9-42f8-b204-39f7188b1524 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:58.578786 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2c70fe76-37c9-42f8-b204-39f7188b1524 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:58.579242 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2c70fe76-37c9-42f8-b204-39f7188b1524 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:58.579669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2c70fe76-37c9-42f8-b204-39f7188b1524 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-2c70fe76-37c9-42f8-b204-39f7188b1524 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] HTTP exception thrown: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2c70fe76-37c9-42f8-b204-39f7188b1524 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Request method failure captured: Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 HTTP/1.1 Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsNoDTHn4-FKCM-pw08haUU-18wBooHgKYDMZ9YT7YD_3cF7BnnsRI00kcocU6uEn6J_TPzKwIQMuiRAjJyt0Gw1eMAbBj8EfX1TPGQOLVDEfaFSRLk8-k8JoGE04xzyk--FLOLi2mGlQRnequ-h-k77WoQbj4sSFOHwt4Huzc6W7g Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 8352a8d484e24264a536b8960dab338f Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:07:58.606806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:07:58.608841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8352a8d484e24264a536b8960dab338f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8352a8d484e24264a536b8960dab338f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8352a8d484e24264a536b8960dab338f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8352a8d484e24264a536b8960dab338f"}]}] Sep 01 14:07:58.608841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:58.608841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 8352a8d484e24264a536b8960dab338f Sep 01 14:07:58.608841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-AttachVolumeTestJSON-547809350 Sep 01 14:07:58.608841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-AttachVolumeTestJSON-547809350-project Sep 01 14:07:58.608841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:07:58.608841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:07:58.608841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 1943057b69d342d9b45fc02be9f3d5aa Sep 01 14:07:58.608841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-AttachVolumeTestJSON-547809350-project Sep 01 14:07:58.608841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:07:58.608841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:07:58.608841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '95b52d39-e40f-40a7-8bde-3d47790fb1d2'} Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:07:58.610056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. Sep 01 14:07:58.611661 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:07:58.613146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2c70fe76-37c9-42f8-b204-39f7188b1524 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] Returning 404 to user: Instance 95b52d39-e40f-40a7-8bde-3d47790fb1d2 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:07:58.613146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2c70fe76-37c9-42f8-b204-39f7188b1524 tempest-AttachVolumeTestJSON-547809350 tempest-AttachVolumeTestJSON-547809350-project] 10.222.0.61 "GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2" status: 404 len: 111 microversion: 2.1 time: 0.031268 Sep 01 14:07:58.613146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 492/985] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:07:58 2022] GET /compute/v2.1/servers/95b52d39-e40f-40a7-8bde-3d47790fb1d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:07:58.914841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5a91d7c3-59bb-4b78-bcc4-3d839e714b83 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:07:58.915728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-5a91d7c3-59bb-4b78-bcc4-3d839e714b83 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:07:58.922076 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5a91d7c3-59bb-4b78-bcc4-3d839e714b83 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:58.922565 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5a91d7c3-59bb-4b78-bcc4-3d839e714b83 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:58.923330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5a91d7c3-59bb-4b78-bcc4-3d839e714b83 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:58.923883 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5a91d7c3-59bb-4b78-bcc4-3d839e714b83 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:07:58.924502 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5a91d7c3-59bb-4b78-bcc4-3d839e714b83 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:07:58.925105 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5a91d7c3-59bb-4b78-bcc4-3d839e714b83 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:07:59.092354 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5a91d7c3-59bb-4b78-bcc4-3d839e714b83 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:59.101685 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5a91d7c3-59bb-4b78-bcc4-3d839e714b83 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:59.103250 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5a91d7c3-59bb-4b78-bcc4-3d839e714b83 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:07:59.104506 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-5a91d7c3-59bb-4b78-bcc4-3d839e714b83 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.194565 Sep 01 14:07:59.105135 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 494/986] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:07:58 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:00.127920 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-247929fd-4097-4e51-adf1-a8dd36fdc9c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:00.128600 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-247929fd-4097-4e51-adf1-a8dd36fdc9c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:00.141605 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-247929fd-4097-4e51-adf1-a8dd36fdc9c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:00.142364 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-247929fd-4097-4e51-adf1-a8dd36fdc9c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:00.142989 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-247929fd-4097-4e51-adf1-a8dd36fdc9c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:00.143709 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-247929fd-4097-4e51-adf1-a8dd36fdc9c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:00.144167 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-247929fd-4097-4e51-adf1-a8dd36fdc9c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:00.144665 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-247929fd-4097-4e51-adf1-a8dd36fdc9c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:00.335295 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-247929fd-4097-4e51-adf1-a8dd36fdc9c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:00.346029 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-247929fd-4097-4e51-adf1-a8dd36fdc9c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:00.349294 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-247929fd-4097-4e51-adf1-a8dd36fdc9c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:00.350539 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-247929fd-4097-4e51-adf1-a8dd36fdc9c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1730 microversion: 2.20 time: 0.227106 Sep 01 14:08:00.351095 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 493/987] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:00 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:01.139203 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2a795a9b-17e4-4348-9cb0-f1c9f7029f7f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:01.139774 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2a795a9b-17e4-4348-9cb0-f1c9f7029f7f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:01.152039 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2a795a9b-17e4-4348-9cb0-f1c9f7029f7f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.152880 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2a795a9b-17e4-4348-9cb0-f1c9f7029f7f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.155117 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2a795a9b-17e4-4348-9cb0-f1c9f7029f7f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.156063 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2a795a9b-17e4-4348-9cb0-f1c9f7029f7f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.157652 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2a795a9b-17e4-4348-9cb0-f1c9f7029f7f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.158320 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2a795a9b-17e4-4348-9cb0-f1c9f7029f7f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.251234 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-2a795a9b-17e4-4348-9cb0-f1c9f7029f7f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lazy-loading 'services' on Instance uuid 66fe2a32-ad87-42ac-8aca-7878f7c65c0c {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:08:01.375637 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4634ec01-3259-4792-b9b3-bb07b9c857a1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:01.376211 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4634ec01-3259-4792-b9b3-bb07b9c857a1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:01.385917 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4634ec01-3259-4792-b9b3-bb07b9c857a1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.386667 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4634ec01-3259-4792-b9b3-bb07b9c857a1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.387521 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4634ec01-3259-4792-b9b3-bb07b9c857a1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.388595 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4634ec01-3259-4792-b9b3-bb07b9c857a1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.389280 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4634ec01-3259-4792-b9b3-bb07b9c857a1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.389808 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4634ec01-3259-4792-b9b3-bb07b9c857a1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.546288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4634ec01-3259-4792-b9b3-bb07b9c857a1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:01.555495 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4634ec01-3259-4792-b9b3-bb07b9c857a1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:01.556984 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4634ec01-3259-4792-b9b3-bb07b9c857a1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:01.558363 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4634ec01-3259-4792-b9b3-bb07b9c857a1 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1717 microversion: 2.20 time: 0.187900 Sep 01 14:08:01.558929 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 494/988] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:01 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1717 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 14:08:01.696524 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2a795a9b-17e4-4348-9cb0-f1c9f7029f7f tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/os-volume_attachments/c26299b0-fd68-478e-b073-f861e33a54a0" status: 202 len: 0 microversion: 2.1 time: 0.561671 Sep 01 14:08:01.700336 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 495/989] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 1 14:08:01 2022] DELETE /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/os-volume_attachments/c26299b0-fd68-478e-b073-f861e33a54a0 => generated 0 bytes in 563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:08:01.719361 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6711749a-ce79-4329-9cda-0a60955770d8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:01.721897 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-6711749a-ce79-4329-9cda-0a60955770d8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:01.730777 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6711749a-ce79-4329-9cda-0a60955770d8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.731659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6711749a-ce79-4329-9cda-0a60955770d8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.732341 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6711749a-ce79-4329-9cda-0a60955770d8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.733179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6711749a-ce79-4329-9cda-0a60955770d8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:01.733808 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6711749a-ce79-4329-9cda-0a60955770d8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:01.734355 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6711749a-ce79-4329-9cda-0a60955770d8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:01.774579 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6711749a-ce79-4329-9cda-0a60955770d8 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070447 Sep 01 14:08:01.775759 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 495/990] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:08:01 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:02.789450 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9a0d77bf-c6f6-4a1c-8489-81f08f05233c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:02.793072 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9a0d77bf-c6f6-4a1c-8489-81f08f05233c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:02.804163 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a0d77bf-c6f6-4a1c-8489-81f08f05233c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:02.804814 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a0d77bf-c6f6-4a1c-8489-81f08f05233c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:02.805720 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a0d77bf-c6f6-4a1c-8489-81f08f05233c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:02.806919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a0d77bf-c6f6-4a1c-8489-81f08f05233c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:02.807702 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a0d77bf-c6f6-4a1c-8489-81f08f05233c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:02.808408 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9a0d77bf-c6f6-4a1c-8489-81f08f05233c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:02.882224 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9a0d77bf-c6f6-4a1c-8489-81f08f05233c tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098183 Sep 01 14:08:02.892600 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 496/991] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:08:02 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:03.899292 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a8fa9345-f4f6-4a2d-bad0-c355288d36e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:03.902119 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a8fa9345-f4f6-4a2d-bad0-c355288d36e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:03.908840 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a8fa9345-f4f6-4a2d-bad0-c355288d36e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:03.909332 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a8fa9345-f4f6-4a2d-bad0-c355288d36e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:03.909788 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a8fa9345-f4f6-4a2d-bad0-c355288d36e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:03.910510 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a8fa9345-f4f6-4a2d-bad0-c355288d36e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:03.911048 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a8fa9345-f4f6-4a2d-bad0-c355288d36e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:03.911488 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a8fa9345-f4f6-4a2d-bad0-c355288d36e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:03.945136 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a8fa9345-f4f6-4a2d-bad0-c355288d36e0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049720 Sep 01 14:08:03.945708 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 496/992] 10.222.0.61 () {58 vars in 1302 bytes} [Thu Sep 1 14:08:03 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 14:08:04.010707 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4d2ce074-ee60-4229-9933-c4872a780ca0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:04.011259 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4d2ce074-ee60-4229-9933-c4872a780ca0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:04.017614 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4d2ce074-ee60-4229-9933-c4872a780ca0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:04.018137 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4d2ce074-ee60-4229-9933-c4872a780ca0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:04.018762 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4d2ce074-ee60-4229-9933-c4872a780ca0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:04.019471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4d2ce074-ee60-4229-9933-c4872a780ca0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:04.019966 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4d2ce074-ee60-4229-9933-c4872a780ca0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:04.020471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4d2ce074-ee60-4229-9933-c4872a780ca0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:04.047005 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4d2ce074-ee60-4229-9933-c4872a780ca0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Going to try to terminate instance {{(pid=127811) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:08:04.485867 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4d2ce074-ee60-4229-9933-c4872a780ca0 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 204 len: 0 microversion: 2.1 time: 0.478655 Sep 01 14:08:04.486914 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 497/993] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:08:04 2022] DELETE /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:08:04.495312 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-941c5804-dda6-4606-90ae-6347d0389d31 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:04.495915 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-941c5804-dda6-4606-90ae-6347d0389d31 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:04.501989 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-941c5804-dda6-4606-90ae-6347d0389d31 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:04.502476 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-941c5804-dda6-4606-90ae-6347d0389d31 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:04.503161 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-941c5804-dda6-4606-90ae-6347d0389d31 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:04.503939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-941c5804-dda6-4606-90ae-6347d0389d31 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:04.504591 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-941c5804-dda6-4606-90ae-6347d0389d31 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:04.505643 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-941c5804-dda6-4606-90ae-6347d0389d31 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:04.637374 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-941c5804-dda6-4606-90ae-6347d0389d31 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:04.645129 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-941c5804-dda6-4606-90ae-6347d0389d31 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1680 microversion: 2.1 time: 0.153715 Sep 01 14:08:04.651576 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 497/994] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:04 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:05.667204 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-deb5ca69-5916-4449-9465-af6d092e5809 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:05.668395 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-deb5ca69-5916-4449-9465-af6d092e5809 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:05.675071 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-deb5ca69-5916-4449-9465-af6d092e5809 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:05.675689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-deb5ca69-5916-4449-9465-af6d092e5809 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:05.676229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-deb5ca69-5916-4449-9465-af6d092e5809 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:05.677212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-deb5ca69-5916-4449-9465-af6d092e5809 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:05.677816 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-deb5ca69-5916-4449-9465-af6d092e5809 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:05.678340 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-deb5ca69-5916-4449-9465-af6d092e5809 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:05.820822 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-deb5ca69-5916-4449-9465-af6d092e5809 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:05.829650 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-deb5ca69-5916-4449-9465-af6d092e5809 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1680 microversion: 2.1 time: 0.166899 Sep 01 14:08:05.841816 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 498/995] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:05 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:06.853410 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-65e39dd9-c870-45a6-bd69-95bd9072dcbc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:06.854055 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-65e39dd9-c870-45a6-bd69-95bd9072dcbc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:06.868640 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-65e39dd9-c870-45a6-bd69-95bd9072dcbc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:06.868640 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-65e39dd9-c870-45a6-bd69-95bd9072dcbc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:06.868640 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-65e39dd9-c870-45a6-bd69-95bd9072dcbc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:06.868640 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-65e39dd9-c870-45a6-bd69-95bd9072dcbc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:06.869007 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-65e39dd9-c870-45a6-bd69-95bd9072dcbc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:06.869007 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-65e39dd9-c870-45a6-bd69-95bd9072dcbc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:06.941172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-65e39dd9-c870-45a6-bd69-95bd9072dcbc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:06.950113 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-65e39dd9-c870-45a6-bd69-95bd9072dcbc tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1613 microversion: 2.1 time: 0.101449 Sep 01 14:08:06.951384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 498/996] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:06 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:07.179548 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-f642533c-e738-42be-a435-b2ec0849b19f req-bec9a069-c1ba-44a8-9875-8b27dd94a9e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66fe2a32-ad87-42ac-8aca-7878f7c65c0c", "name": "network-vif-deleted", "tag": "552d6bb2-fe64-4e63-a029-3c894cb1f1aa"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:07.191092 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f642533c-e738-42be-a435-b2ec0849b19f req-bec9a069-c1ba-44a8-9875-8b27dd94a9e7 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:07.191810 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f642533c-e738-42be-a435-b2ec0849b19f req-bec9a069-c1ba-44a8-9875-8b27dd94a9e7 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:07.192898 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f642533c-e738-42be-a435-b2ec0849b19f req-bec9a069-c1ba-44a8-9875-8b27dd94a9e7 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:07.204572 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-f642533c-e738-42be-a435-b2ec0849b19f req-bec9a069-c1ba-44a8-9875-8b27dd94a9e7 service nova] Creating event network-vif-deleted:552d6bb2-fe64-4e63-a029-3c894cb1f1aa for instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c on hv-cinder-85221 Sep 01 14:08:07.210521 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-f642533c-e738-42be-a435-b2ec0849b19f req-bec9a069-c1ba-44a8-9875-8b27dd94a9e7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035350 Sep 01 14:08:07.211112 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 499/997] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:07.973176 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:07.974500 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:07.980967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:07.981460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:07.982157 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:07.982873 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:07.983495 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:07.984089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:08.018991 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:08.019483 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:08.019962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:08.020948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lazy-loading 'fault' on Instance uuid 66fe2a32-ad87-42ac-8aca-7878f7c65c0c {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:08:08.073008 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0afa15991f14e0ca0d3701d06a89049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c19855b809cc43b2925dc3001284baaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:08.083384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-253c467c-a08b-4057-af3b-ea24be8b2871 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 200 len: 1331 microversion: 2.1 time: 0.113647 Sep 01 14:08:08.084580 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 499/998] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:07 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:09.111738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-00774041-c4c4-41f0-b227-0f5e6e6e99b4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:09.112496 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-00774041-c4c4-41f0-b227-0f5e6e6e99b4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:09.120259 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-00774041-c4c4-41f0-b227-0f5e6e6e99b4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:09.120790 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-00774041-c4c4-41f0-b227-0f5e6e6e99b4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:09.121217 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-00774041-c4c4-41f0-b227-0f5e6e6e99b4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:09.122018 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-00774041-c4c4-41f0-b227-0f5e6e6e99b4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:09.122504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-00774041-c4c4-41f0-b227-0f5e6e6e99b4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:09.122993 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-00774041-c4c4-41f0-b227-0f5e6e6e99b4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:09.139452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-00774041-c4c4-41f0-b227-0f5e6e6e99b4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-00774041-c4c4-41f0-b227-0f5e6e6e99b4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c HTTP/1.1 Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:08:09.141922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:08:09.143536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:08:09.143536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:09.143536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:09.143536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:09.143536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:09.143536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:08:09.143536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:08:09.143536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:08:09.143536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:09.143536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:08:09.143536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:09.143536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '66fe2a32-ad87-42ac-8aca-7878f7c65c0c'} Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:09.147801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:09.149636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:09.151216 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-00774041-c4c4-41f0-b227-0f5e6e6e99b4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 404 to user: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:09.151216 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-00774041-c4c4-41f0-b227-0f5e6e6e99b4 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 404 len: 111 microversion: 2.1 time: 0.036096 Sep 01 14:08:09.151216 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 500/999] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:09 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:08:09.156554 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-07931b58-a995-43ad-b3ec-3f931b586bee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '.version_select at 0x7f1afd4e65e0>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:09.305059 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-07931b58-a995-43ad-b3ec-3f931b586bee tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-413344916" status: 202 len: 0 microversion: 2.1 time: 0.152197 Sep 01 14:08:09.305638 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 500/1000] 10.222.0.61 () {58 vars in 1218 bytes} [Thu Sep 1 14:08:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-413344916 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:08:11.695535 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2e6c5ce5-a2cf-4834-9f26-0a1db8feb628 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:11.696030 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2e6c5ce5-a2cf-4834-9f26-0a1db8feb628 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:11.702984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2e6c5ce5-a2cf-4834-9f26-0a1db8feb628 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:11.703647 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2e6c5ce5-a2cf-4834-9f26-0a1db8feb628 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:11.704080 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2e6c5ce5-a2cf-4834-9f26-0a1db8feb628 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:11.704777 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2e6c5ce5-a2cf-4834-9f26-0a1db8feb628 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:11.705230 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2e6c5ce5-a2cf-4834-9f26-0a1db8feb628 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:11.705650 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2e6c5ce5-a2cf-4834-9f26-0a1db8feb628 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:11.719947 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-2e6c5ce5-a2cf-4834-9f26-0a1db8feb628 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2e6c5ce5-a2cf-4834-9f26-0a1db8feb628 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: DELETE /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c HTTP/1.1 Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:08:11.721560 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:08:11.723185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:08:11.723185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:11.723185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:11.723185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:11.723185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:11.723185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:08:11.723185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:08:11.723185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:08:11.723185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:11.723185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:08:11.723185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:11.723185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '66fe2a32-ad87-42ac-8aca-7878f7c65c0c'} Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:11.727738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:11.729139 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:11.730511 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2e6c5ce5-a2cf-4834-9f26-0a1db8feb628 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 404 to user: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:11.730511 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2e6c5ce5-a2cf-4834-9f26-0a1db8feb628 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 404 len: 111 microversion: 2.1 time: 0.031288 Sep 01 14:08:11.730511 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 501/1001] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:08:11 2022] DELETE /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:11.733369 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-688c8694-b478-42be-a3dd-cc6a8642b81d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:11.734033 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-688c8694-b478-42be-a3dd-cc6a8642b81d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 66fe2a32-ad87-42ac-8aca-7878f7c65c0c] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:11.742290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-688c8694-b478-42be-a3dd-cc6a8642b81d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:11.742779 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-688c8694-b478-42be-a3dd-cc6a8642b81d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:11.743221 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-688c8694-b478-42be-a3dd-cc6a8642b81d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:11.743930 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-688c8694-b478-42be-a3dd-cc6a8642b81d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:11.744388 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-688c8694-b478-42be-a3dd-cc6a8642b81d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:11.744816 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-688c8694-b478-42be-a3dd-cc6a8642b81d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:11.760877 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-688c8694-b478-42be-a3dd-cc6a8642b81d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-688c8694-b478-42be-a3dd-cc6a8642b81d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c HTTP/1.1 Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:08:11.762645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:08:11.764285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:08:11.764285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:11.764285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:11.764285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:11.764285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:11.764285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:08:11.764285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:08:11.764285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:08:11.764285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:11.764285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:08:11.764285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:11.764285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '66fe2a32-ad87-42ac-8aca-7878f7c65c0c'} Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:11.765131 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. Sep 01 14:08:11.766515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:11.767684 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-688c8694-b478-42be-a3dd-cc6a8642b81d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 404 to user: Instance 66fe2a32-ad87-42ac-8aca-7878f7c65c0c could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:11.767684 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-688c8694-b478-42be-a3dd-cc6a8642b81d tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c" status: 404 len: 111 microversion: 2.1 time: 0.035548 Sep 01 14:08:11.767684 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 501/1002] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:11 2022] GET /compute/v2.1/servers/66fe2a32-ad87-42ac-8aca-7878f7c65c0c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:13.188341 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4f3a120a-89d4-47d9-80ba-3c9a0c5671e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:13.188875 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4f3a120a-89d4-47d9-80ba-3c9a0c5671e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:13.195956 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4f3a120a-89d4-47d9-80ba-3c9a0c5671e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.196447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4f3a120a-89d4-47d9-80ba-3c9a0c5671e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.196888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4f3a120a-89d4-47d9-80ba-3c9a0c5671e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:13.197621 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4f3a120a-89d4-47d9-80ba-3c9a0c5671e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.198128 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4f3a120a-89d4-47d9-80ba-3c9a0c5671e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.198557 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4f3a120a-89d4-47d9-80ba-3c9a0c5671e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:13.202956 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-4f3a120a-89d4-47d9-80ba-3c9a0c5671e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4f3a120a-89d4-47d9-80ba-3c9a0c5671e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: DELETE /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 HTTP/1.1 Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:08:13.215586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:08:13.217488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:08:13.217488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:13.217488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:13.217488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:13.217488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:13.217488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:08:13.217488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:08:13.217488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:08:13.217488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:13.217488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:08:13.217488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:08:13.217488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '38f7ccdd-5ecd-4809-b3e7-8ae4295552e9'} Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:13.218420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:08:13.220717 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.224869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4f3a120a-89d4-47d9-80ba-3c9a0c5671e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 404 to user: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:13.224869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4f3a120a-89d4-47d9-80ba-3c9a0c5671e2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 404 len: 111 microversion: 2.1 time: 0.031609 Sep 01 14:08:13.224869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 502/1003] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:08:13 2022] DELETE /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:13.227729 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1ca23c6b-8163-45e0-a737-3d89c838f1f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:13.228460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1ca23c6b-8163-45e0-a737-3d89c838f1f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:13.236260 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1ca23c6b-8163-45e0-a737-3d89c838f1f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.236768 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1ca23c6b-8163-45e0-a737-3d89c838f1f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.237673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1ca23c6b-8163-45e0-a737-3d89c838f1f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:13.237927 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1ca23c6b-8163-45e0-a737-3d89c838f1f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.238382 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1ca23c6b-8163-45e0-a737-3d89c838f1f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.238805 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1ca23c6b-8163-45e0-a737-3d89c838f1f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:13.254309 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-1ca23c6b-8163-45e0-a737-3d89c838f1f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1ca23c6b-8163-45e0-a737-3d89c838f1f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 HTTP/1.1 Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:08:13.256642 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:08:13.258313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:08:13.258313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:13.258313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:13.258313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:13.258313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:13.258313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:08:13.258313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:08:13.258313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:08:13.258313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:13.258313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:08:13.258313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:08:13.258313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '38f7ccdd-5ecd-4809-b3e7-8ae4295552e9'} Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:13.259152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. Sep 01 14:08:13.260392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.261480 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1ca23c6b-8163-45e0-a737-3d89c838f1f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 404 to user: Instance 38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:13.261480 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1ca23c6b-8163-45e0-a737-3d89c838f1f2 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9" status: 404 len: 111 microversion: 2.1 time: 0.035129 Sep 01 14:08:13.261480 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 502/1004] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:13 2022] GET /compute/v2.1/servers/38f7ccdd-5ecd-4809-b3e7-8ae4295552e9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:13.267456 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-03b05356-6c6e-4923-9834-11e2c9eccabd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:13.267999 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-03b05356-6c6e-4923-9834-11e2c9eccabd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:13.274721 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-03b05356-6c6e-4923-9834-11e2c9eccabd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.275373 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-03b05356-6c6e-4923-9834-11e2c9eccabd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.275838 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-03b05356-6c6e-4923-9834-11e2c9eccabd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:13.276565 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-03b05356-6c6e-4923-9834-11e2c9eccabd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.277024 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-03b05356-6c6e-4923-9834-11e2c9eccabd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.277454 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-03b05356-6c6e-4923-9834-11e2c9eccabd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:13.292100 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-03b05356-6c6e-4923-9834-11e2c9eccabd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-03b05356-6c6e-4923-9834-11e2c9eccabd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: DELETE /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 HTTP/1.1 Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:08:13.293726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:08:13.296537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:08:13.296537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:13.296537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:13.296537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:13.296537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:13.296537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:08:13.296537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:08:13.296537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:08:13.296537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:13.296537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:08:13.296537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:08:13.296537 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '237052f9-426e-430e-b59c-ffc2f03c9e11'} Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:13.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:08:13.299049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.300569 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-03b05356-6c6e-4923-9834-11e2c9eccabd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 404 to user: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:13.300569 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-03b05356-6c6e-4923-9834-11e2c9eccabd tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 404 len: 111 microversion: 2.1 time: 0.031986 Sep 01 14:08:13.300569 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 503/1005] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:08:13 2022] DELETE /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:13.306615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-025ba0e9-b05d-45ca-88bc-71445b2c31b7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:13.307226 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-025ba0e9-b05d-45ca-88bc-71445b2c31b7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 237052f9-426e-430e-b59c-ffc2f03c9e11] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:13.313469 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-025ba0e9-b05d-45ca-88bc-71445b2c31b7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.314044 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-025ba0e9-b05d-45ca-88bc-71445b2c31b7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.314480 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-025ba0e9-b05d-45ca-88bc-71445b2c31b7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:13.315175 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-025ba0e9-b05d-45ca-88bc-71445b2c31b7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:13.315620 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-025ba0e9-b05d-45ca-88bc-71445b2c31b7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:13.316051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-025ba0e9-b05d-45ca-88bc-71445b2c31b7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:13.332397 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-025ba0e9-b05d-45ca-88bc-71445b2c31b7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-025ba0e9-b05d-45ca-88bc-71445b2c31b7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 HTTP/1.1 Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:08:13.334058 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:08:13.336959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:08:13.336959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:13.336959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:13.336959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:13.336959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:13.336959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:08:13.336959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:08:13.336959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:08:13.336959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:13.336959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:08:13.336959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:08:13.336959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '237052f9-426e-430e-b59c-ffc2f03c9e11'} Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:13.337703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. Sep 01 14:08:13.338956 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:13.340167 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-025ba0e9-b05d-45ca-88bc-71445b2c31b7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 404 to user: Instance 237052f9-426e-430e-b59c-ffc2f03c9e11 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:13.340167 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-025ba0e9-b05d-45ca-88bc-71445b2c31b7 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11" status: 404 len: 111 microversion: 2.1 time: 0.033503 Sep 01 14:08:13.340167 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 503/1006] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:13 2022] GET /compute/v2.1/servers/237052f9-426e-430e-b59c-ffc2f03c9e11 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:14.815651 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7a7a3514-dac8-43f8-b12d-60259fd11adb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:14.816144 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7a7a3514-dac8-43f8-b12d-60259fd11adb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:14.823994 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7a7a3514-dac8-43f8-b12d-60259fd11adb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:14.824400 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7a7a3514-dac8-43f8-b12d-60259fd11adb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:14.824836 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7a7a3514-dac8-43f8-b12d-60259fd11adb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:14.825536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7a7a3514-dac8-43f8-b12d-60259fd11adb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:14.826032 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7a7a3514-dac8-43f8-b12d-60259fd11adb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:14.826463 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7a7a3514-dac8-43f8-b12d-60259fd11adb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:14.840349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-7a7a3514-dac8-43f8-b12d-60259fd11adb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7a7a3514-dac8-43f8-b12d-60259fd11adb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: DELETE /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa HTTP/1.1 Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:08:14.841928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:08:14.843765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:08:14.843765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:14.843765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:14.843765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:14.843765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:14.843765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:08:14.843765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:08:14.843765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:08:14.843765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:14.843765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:08:14.843765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:08:14.843765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa'} Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:14.845002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:08:14.853847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:14.855675 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7a7a3514-dac8-43f8-b12d-60259fd11adb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 404 to user: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:14.855675 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7a7a3514-dac8-43f8-b12d-60259fd11adb tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 404 len: 111 microversion: 2.1 time: 0.031543 Sep 01 14:08:14.855675 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 504/1007] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:08:14 2022] DELETE /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:14.855905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7c1e2532-53f8-4726-968e-117e148729f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:14.856794 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7c1e2532-53f8-4726-968e-117e148729f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] [instance: 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:14.864533 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7c1e2532-53f8-4726-968e-117e148729f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:14.865041 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7c1e2532-53f8-4726-968e-117e148729f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:14.865489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7c1e2532-53f8-4726-968e-117e148729f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:14.866940 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7c1e2532-53f8-4726-968e-117e148729f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:14.867639 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7c1e2532-53f8-4726-968e-117e148729f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:14.867883 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7c1e2532-53f8-4726-968e-117e148729f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:14.882564 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-7c1e2532-53f8-4726-968e-117e148729f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] HTTP exception thrown: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7c1e2532-53f8-4726-968e-117e148729f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Request method failure captured: Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa HTTP/1.1 Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsQT7TxcNprWstYsw6J8DM4KaEdAw7wJfxafR1thmMgzskQqjKO53zYMfffbVsZiXeF-iIo_gnMAWlETLISAQwx4TQtgJTjd-MwJ1BrFykLJ6bGhLG1hjGabel_kzChFkGeYpr23QVql76gov846Fl3uhTt-BNsuKSlGyRsgOMnIH4 Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:08:14.884347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:08:14.885817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c19855b809cc43b2925dc3001284baaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c19855b809cc43b2925dc3001284baaa"}]}] Sep 01 14:08:14.885817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:14.885817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: c19855b809cc43b2925dc3001284baaa Sep 01 14:08:14.885817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2085664917 Sep 01 14:08:14.885817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:14.885817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:08:14.885817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:08:14.885817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: c0afa15991f14e0ca0d3701d06a89049 Sep 01 14:08:14.885817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-AttachVolumeNegativeTest-2085664917-project Sep 01 14:08:14.885817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:08:14.885817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:08:14.885817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa'} Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:14.901549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. Sep 01 14:08:14.903529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:14.904694 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7c1e2532-53f8-4726-968e-117e148729f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] Returning 404 to user: Instance 7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:14.904694 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7c1e2532-53f8-4726-968e-117e148729f6 tempest-AttachVolumeNegativeTest-2085664917 tempest-AttachVolumeNegativeTest-2085664917-project] 10.222.0.61 "GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa" status: 404 len: 111 microversion: 2.1 time: 0.038079 Sep 01 14:08:14.904694 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 504/1008] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:14 2022] GET /compute/v2.1/servers/7c9ea96a-11b5-4398-84ae-a4d03ef2aeaa => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:16.374485 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d4f67ed7-f601-4b20-adb9-0c8013901171 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:16.375066 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d4f67ed7-f601-4b20-adb9-0c8013901171 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:16.382400 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4f67ed7-f601-4b20-adb9-0c8013901171 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:16.383197 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4f67ed7-f601-4b20-adb9-0c8013901171 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:16.383977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4f67ed7-f601-4b20-adb9-0c8013901171 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:16.384860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4f67ed7-f601-4b20-adb9-0c8013901171 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:16.385504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4f67ed7-f601-4b20-adb9-0c8013901171 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:16.386648 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4f67ed7-f601-4b20-adb9-0c8013901171 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:16.425541 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d4f67ed7-f601-4b20-adb9-0c8013901171 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Going to try to terminate instance {{(pid=127811) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:08:17.088300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d4f67ed7-f601-4b20-adb9-0c8013901171 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 204 len: 0 microversion: 2.1 time: 0.707330 Sep 01 14:08:17.088300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 505/1009] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:08:16 2022] DELETE /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:08:17.093816 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f9ea6ea9-faec-4491-9011-daf4539e2039 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:17.095347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f9ea6ea9-faec-4491-9011-daf4539e2039 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:17.103314 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f9ea6ea9-faec-4491-9011-daf4539e2039 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:17.104017 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f9ea6ea9-faec-4491-9011-daf4539e2039 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:17.104645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f9ea6ea9-faec-4491-9011-daf4539e2039 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:17.105732 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f9ea6ea9-faec-4491-9011-daf4539e2039 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:17.106442 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f9ea6ea9-faec-4491-9011-daf4539e2039 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:17.107055 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f9ea6ea9-faec-4491-9011-daf4539e2039 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:17.318404 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f9ea6ea9-faec-4491-9011-daf4539e2039 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:17.322798 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:17.329413 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f9ea6ea9-faec-4491-9011-daf4539e2039 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1576 microversion: 2.1 time: 0.238944 Sep 01 14:08:17.330371 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 505/1010] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:17 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:18.356964 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9367eb7a-1cc4-476c-9c88-0bb8c84d7a33 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:18.358915 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9367eb7a-1cc4-476c-9c88-0bb8c84d7a33 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:18.381232 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9367eb7a-1cc4-476c-9c88-0bb8c84d7a33 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:18.381232 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9367eb7a-1cc4-476c-9c88-0bb8c84d7a33 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:18.381232 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9367eb7a-1cc4-476c-9c88-0bb8c84d7a33 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:18.381232 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9367eb7a-1cc4-476c-9c88-0bb8c84d7a33 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:18.381680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9367eb7a-1cc4-476c-9c88-0bb8c84d7a33 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:18.381680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9367eb7a-1cc4-476c-9c88-0bb8c84d7a33 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:19.017202 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9367eb7a-1cc4-476c-9c88-0bb8c84d7a33 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:19.026364 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9367eb7a-1cc4-476c-9c88-0bb8c84d7a33 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1576 microversion: 2.1 time: 0.673911 Sep 01 14:08:19.027214 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 506/1011] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:18 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1576 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:20.051573 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9283d190-bfb7-44ba-8abd-308b2ebb94e1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:20.051573 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9283d190-bfb7-44ba-8abd-308b2ebb94e1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:20.054205 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:20.066180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9283d190-bfb7-44ba-8abd-308b2ebb94e1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:20.066180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9283d190-bfb7-44ba-8abd-308b2ebb94e1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:20.066180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9283d190-bfb7-44ba-8abd-308b2ebb94e1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:20.066180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9283d190-bfb7-44ba-8abd-308b2ebb94e1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:20.066811 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9283d190-bfb7-44ba-8abd-308b2ebb94e1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:20.067046 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9283d190-bfb7-44ba-8abd-308b2ebb94e1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:20.198978 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9283d190-bfb7-44ba-8abd-308b2ebb94e1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:20.206410 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-850e9222-f209-4dc3-9f43-4ebc982e6a7b req-f068bb1e-7eec-49ea-ac09-02894b9e96fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec24f5b-aec6-406b-bf20-dd2e3d4e8438", "name": "network-vif-deleted", "tag": "b21bbade-8af9-44b2-960e-25704dbd478c"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:20.221198 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9283d190-bfb7-44ba-8abd-308b2ebb94e1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1509 microversion: 2.1 time: 0.172874 Sep 01 14:08:20.222197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 506/1012] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:20 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:20.225918 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-850e9222-f209-4dc3-9f43-4ebc982e6a7b req-f068bb1e-7eec-49ea-ac09-02894b9e96fe service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:20.226576 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-850e9222-f209-4dc3-9f43-4ebc982e6a7b req-f068bb1e-7eec-49ea-ac09-02894b9e96fe service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:20.227028 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-850e9222-f209-4dc3-9f43-4ebc982e6a7b req-f068bb1e-7eec-49ea-ac09-02894b9e96fe service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:20.249955 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-850e9222-f209-4dc3-9f43-4ebc982e6a7b req-f068bb1e-7eec-49ea-ac09-02894b9e96fe service nova] Creating event network-vif-deleted:b21bbade-8af9-44b2-960e-25704dbd478c for instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 on hv-cinder-85221 Sep 01 14:08:20.268292 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-850e9222-f209-4dc3-9f43-4ebc982e6a7b req-f068bb1e-7eec-49ea-ac09-02894b9e96fe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073802 Sep 01 14:08:20.268911 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 507/1013] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:21.244046 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:21.246769 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:21.255336 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:21.256210 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:21.257324 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:21.258887 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:21.259354 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:21.259818 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:21.296443 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:21.296931 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:21.297371 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:21.297839 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lazy-loading 'fault' on Instance uuid 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:08:21.345702 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:21.354266 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a17de668-0f87-4c7d-86f5-00d0ff60f249 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 200 len: 1230 microversion: 2.1 time: 0.114733 Sep 01 14:08:21.354869 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 507/1014] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:21 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:22.377846 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-df242c9d-d95c-4ea6-86e3-0ec3ee496693 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:22.379114 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-df242c9d-d95c-4ea6-86e3-0ec3ee496693 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:22.385303 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-df242c9d-d95c-4ea6-86e3-0ec3ee496693 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:22.386199 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-df242c9d-d95c-4ea6-86e3-0ec3ee496693 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:22.386590 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-df242c9d-d95c-4ea6-86e3-0ec3ee496693 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:22.387185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-df242c9d-d95c-4ea6-86e3-0ec3ee496693 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:22.387822 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-df242c9d-d95c-4ea6-86e3-0ec3ee496693 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:22.388250 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-df242c9d-d95c-4ea6-86e3-0ec3ee496693 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:22.402775 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-df242c9d-d95c-4ea6-86e3-0ec3ee496693 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] HTTP exception thrown: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-df242c9d-d95c-4ea6-86e3-0ec3ee496693 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Request method failure captured: Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 HTTP/1.1 Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELwUAd9uZvipXIPvhrAl9M1gbALqYrwCACOdFsg6eEYQQ0SbUtKohFPV4qiStan4YPpxBQ8-doa6Z8WMTQdSfASO9jJuuWAQfy2y5R9s3ElypO0zXeJlLDJrQvJyMORMqWq-1O-uVzpu7bg3dGq5pnRQZTBWxtxdZQrfUPQBsAk0OX0 Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 9086ba5c610d4954a238d6569ec32f0b Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-TestVolumeBootPattern-185563680 Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:08:22.404617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:08:22.407360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9086ba5c610d4954a238d6569ec32f0b"}]}] Sep 01 14:08:22.407360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-TestVolumeBootPattern-185563680 Sep 01 14:08:22.407360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 9086ba5c610d4954a238d6569ec32f0b Sep 01 14:08:22.407360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-TestVolumeBootPattern-185563680 Sep 01 14:08:22.407360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-TestVolumeBootPattern-185563680-project Sep 01 14:08:22.407360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:08:22.407360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:08:22.407360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 748b8b4771ac498a88fdd98c8a4914ad Sep 01 14:08:22.407360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-TestVolumeBootPattern-185563680-project Sep 01 14:08:22.407360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:08:22.407360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:08:22.407360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '9ec24f5b-aec6-406b-bf20-dd2e3d4e8438'} Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:22.408385 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:08:22.409916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:22.411268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-df242c9d-d95c-4ea6-86e3-0ec3ee496693 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Returning 404 to user: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:22.411268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-df242c9d-d95c-4ea6-86e3-0ec3ee496693 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 404 len: 111 microversion: 2.1 time: 0.033108 Sep 01 14:08:22.411268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 508/1015] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:22 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 14:08:22.548773 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1637477038", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1757307735", "security_groups": [{"name": "tempest-secgroup-smoke-541905587"}], "block_device_mapping_v2": [{"uuid": "9239a501-96bc-4614-a8b1-60f46ec94415", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7c0e430-8712-4da5-b970-a9a556e70461"}]}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:22.669282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.network.neutron [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] validate_networks() for [('e7c0e430-8712-4da5-b970-a9a556e70461', None, None, None, None, None)] {{(pid=127812) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:08:23.084811 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Flavor limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:08:23.085522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Image limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:08:23.086800 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Flavor pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:08:23.087487 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Image pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:08:23.088276 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:08:23.097376 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.098238 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.098891 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.099805 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:23.100643 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:23.101264 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:23.120788 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Getting quotas for project 9086ba5c610d4954a238d6569ec32f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:08:23.125135 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Getting quotas for user 748b8b4771ac498a88fdd98c8a4914ad and project 9086ba5c610d4954a238d6569ec32f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:08:23.135330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-01e98974-089c-48ed-bf15-f02827fd7fe2 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Action: 'create', calling method: .version_select at 0x7f1b00cc1280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-801177676"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:23.187809 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Going to run 1 instances... {{(pid=127812) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:08:23.189998 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9239a501-96bc-4614-a8b1-60f46ec94415',volume_size=None,volume_type=None)] {{(pid=127812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:08:24.088669 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-01e98974-089c-48ed-bf15-f02827fd7fe2 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.212639 Sep 01 14:08:24.089299 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 509/1016] 10.222.0.61 () {60 vars in 1155 bytes} [Thu Sep 1 14:08:22 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1214 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 14:08:24.102674 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-89107227-7f42-4d7c-8153-f2691759c0c7 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1b00bd4dc0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:24.245187 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e8c74ce8-850b-4e98-8ce9-8c8ee9bc923c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.700230 Sep 01 14:08:24.252298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 508/1017] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:08:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:08:24.257483 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4ac12639-6ffa-434f-9a2a-76beac187544 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:24.258162 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4ac12639-6ffa-434f-9a2a-76beac187544 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:24.321472 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-89107227-7f42-4d7c-8153-f2691759c0c7 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273" status: 200 len: 344 microversion: 2.1 time: 0.223505 Sep 01 14:08:24.322056 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4ac12639-6ffa-434f-9a2a-76beac187544 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:24.322233 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 510/1018] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:08:24 2022] GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273 => generated 344 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:08:24.330002 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4ac12639-6ffa-434f-9a2a-76beac187544 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1095 microversion: 2.1 time: 0.076555 Sep 01 14:08:24.330719 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 509/1019] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:24 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:25.335557 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-6718c49e-21c3-4c49-936f-e04bdab713ce tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd6f01f0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:25.352870 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9e9ee4de-cf09-464d-86cf-f788920caadc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:25.354145 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9e9ee4de-cf09-464d-86cf-f788920caadc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:25.390386 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-6718c49e-21c3-4c49-936f-e04bdab713ce tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273" status: 200 len: 345 microversion: 2.1 time: 0.058749 Sep 01 14:08:25.391430 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 511/1020] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:08:25 2022] GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:25.404293 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0116bda3-c7a4-4c06-8418-42bd4455bbf3 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Action: 'create', calling method: .version_select at 0x7f1afd313c10>, body: {"snapshot": {"volume_id": "1dc9b421-8bfe-4fc7-8641-af6356b0c273", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-721093571"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:25.425128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9e9ee4de-cf09-464d-86cf-f788920caadc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:25.435746 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9e9ee4de-cf09-464d-86cf-f788920caadc tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1095 microversion: 2.1 time: 0.088961 Sep 01 14:08:25.436363 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 510/1021] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:25 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1095 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:26.160179 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0116bda3-c7a4-4c06-8418-42bd4455bbf3 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.759938 Sep 01 14:08:26.160765 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 512/1022] 10.222.0.61 () {60 vars in 1162 bytes} [Thu Sep 1 14:08:25 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:08:26.174135 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7e0440da-4bf2-4380-9ebd-8cbc696aa348 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd56f700>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:26.208697 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7e0440da-4bf2-4380-9ebd-8cbc696aa348 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406" status: 200 len: 286 microversion: 2.1 time: 0.038480 Sep 01 14:08:26.219015 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 511/1023] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 1 14:08:26 2022] GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:26.231494 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b4a94196-adf2-414f-b699-1860c4acfd45 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1b00bd4310>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:26.269292 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b4a94196-adf2-414f-b699-1860c4acfd45 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.043096 Sep 01 14:08:26.269908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 513/1024] 10.222.0.61 () {58 vars in 1140 bytes} [Thu Sep 1 14:08:26 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:26.283091 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b2042ab9-3dad-412b-b8a7-e4703bcb65ee tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd4e6ca0>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:26.325538 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b2042ab9-3dad-412b-b8a7-e4703bcb65ee tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406" status: 200 len: 286 microversion: 2.1 time: 0.046722 Sep 01 14:08:26.331826 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 512/1025] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 1 14:08:26 2022] GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:26.457556 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-dc678293-4302-424a-8a18-11c5e1f55d5a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:26.458580 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-dc678293-4302-424a-8a18-11c5e1f55d5a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:26.462520 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:26.468915 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc678293-4302-424a-8a18-11c5e1f55d5a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:26.469536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc678293-4302-424a-8a18-11c5e1f55d5a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:26.470088 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc678293-4302-424a-8a18-11c5e1f55d5a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:26.470866 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc678293-4302-424a-8a18-11c5e1f55d5a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:26.471393 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc678293-4302-424a-8a18-11c5e1f55d5a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:26.472105 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-dc678293-4302-424a-8a18-11c5e1f55d5a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:26.550247 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-dc678293-4302-424a-8a18-11c5e1f55d5a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:26.558286 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-dc678293-4302-424a-8a18-11c5e1f55d5a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1193 microversion: 2.1 time: 0.105502 Sep 01 14:08:26.558868 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 514/1026] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:26 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:27.338980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-70ff7577-e660-40c4-81fe-470c6ad06d18 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd364a60>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:27.370887 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-70ff7577-e660-40c4-81fe-470c6ad06d18 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406" status: 200 len: 286 microversion: 2.1 time: 0.036046 Sep 01 14:08:27.376595 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 513/1027] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 1 14:08:27 2022] GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:27.596176 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7bd8497d-ab88-4dfb-b454-6e1a4f535275 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:27.596783 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7bd8497d-ab88-4dfb-b454-6e1a4f535275 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:27.604239 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7bd8497d-ab88-4dfb-b454-6e1a4f535275 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:27.604732 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7bd8497d-ab88-4dfb-b454-6e1a4f535275 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:27.610336 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7bd8497d-ab88-4dfb-b454-6e1a4f535275 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:27.610336 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7bd8497d-ab88-4dfb-b454-6e1a4f535275 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:27.610336 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7bd8497d-ab88-4dfb-b454-6e1a4f535275 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:27.610336 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7bd8497d-ab88-4dfb-b454-6e1a4f535275 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:27.675836 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7bd8497d-ab88-4dfb-b454-6e1a4f535275 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:27.683716 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7bd8497d-ab88-4dfb-b454-6e1a4f535275 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1193 microversion: 2.1 time: 0.091983 Sep 01 14:08:27.684289 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 515/1028] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:27 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1193 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:28.387608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-45059c31-772e-4775-b8b1-e51aeb79776c tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd56f820>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:28.438738 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-45059c31-772e-4775-b8b1-e51aeb79776c tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406" status: 200 len: 286 microversion: 2.1 time: 0.057653 Sep 01 14:08:28.439398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 514/1029] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 1 14:08:28 2022] GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:28.704950 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d660b47a-b7bf-4557-8da7-bcd0f9cfc466 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:28.706508 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d660b47a-b7bf-4557-8da7-bcd0f9cfc466 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:28.714343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d660b47a-b7bf-4557-8da7-bcd0f9cfc466 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:28.714831 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d660b47a-b7bf-4557-8da7-bcd0f9cfc466 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:28.715257 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d660b47a-b7bf-4557-8da7-bcd0f9cfc466 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:28.716343 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d660b47a-b7bf-4557-8da7-bcd0f9cfc466 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:28.716793 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d660b47a-b7bf-4557-8da7-bcd0f9cfc466 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:28.717220 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d660b47a-b7bf-4557-8da7-bcd0f9cfc466 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:28.797512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d660b47a-b7bf-4557-8da7-bcd0f9cfc466 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:28.811865 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d660b47a-b7bf-4557-8da7-bcd0f9cfc466 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1193 microversion: 2.1 time: 0.110387 Sep 01 14:08:28.812661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 516/1030] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:28 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1193 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:29.453286 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4b2e3ec4-b506-4dd4-a0b0-07e6e0621618 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd4da700>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:29.483715 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4b2e3ec4-b506-4dd4-a0b0-07e6e0621618 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406" status: 200 len: 286 microversion: 2.1 time: 0.035276 Sep 01 14:08:29.484294 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 515/1031] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 1 14:08:29 2022] GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:29.838827 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-950b90c7-e70e-486b-ab72-21bd18987420 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:29.839476 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-950b90c7-e70e-486b-ab72-21bd18987420 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:29.846477 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-950b90c7-e70e-486b-ab72-21bd18987420 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:29.846967 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-950b90c7-e70e-486b-ab72-21bd18987420 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:29.847402 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-950b90c7-e70e-486b-ab72-21bd18987420 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:29.848100 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-950b90c7-e70e-486b-ab72-21bd18987420 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:29.848556 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-950b90c7-e70e-486b-ab72-21bd18987420 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:29.848978 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-950b90c7-e70e-486b-ab72-21bd18987420 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:29.920551 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-950b90c7-e70e-486b-ab72-21bd18987420 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:29.928345 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-950b90c7-e70e-486b-ab72-21bd18987420 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1193 microversion: 2.1 time: 0.097550 Sep 01 14:08:29.928939 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 517/1032] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:29 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:30.497454 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-77dead02-476b-4ca2-8553-557439a31740 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd48ab80>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:30.955707 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0712af03-64ba-4a85-aa49-08a84ab58846 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:30.957274 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0712af03-64ba-4a85-aa49-08a84ab58846 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:30.965086 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0712af03-64ba-4a85-aa49-08a84ab58846 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:30.965657 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0712af03-64ba-4a85-aa49-08a84ab58846 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:30.966195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0712af03-64ba-4a85-aa49-08a84ab58846 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:30.966968 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0712af03-64ba-4a85-aa49-08a84ab58846 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:30.967703 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0712af03-64ba-4a85-aa49-08a84ab58846 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:30.968268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0712af03-64ba-4a85-aa49-08a84ab58846 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:31.130762 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0712af03-64ba-4a85-aa49-08a84ab58846 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:31.139545 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0712af03-64ba-4a85-aa49-08a84ab58846 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1278 microversion: 2.1 time: 0.192459 Sep 01 14:08:31.140123 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 518/1033] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:30 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1278 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:31.408955 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-77dead02-476b-4ca2-8553-557439a31740 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406" status: 200 len: 287 microversion: 2.1 time: 0.915216 Sep 01 14:08:31.409714 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 516/1034] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 1 14:08:30 2022] GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406 => generated 287 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:31.423222 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9a4d018b-4c8c-4f7d-a37f-0e60fda431f0 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1b00bd4f70>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:31.872589 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9a4d018b-4c8c-4f7d-a37f-0e60fda431f0 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406" status: 202 len: 0 microversion: 2.1 time: 0.454869 Sep 01 14:08:31.873164 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 519/1035] 10.222.0.61 () {58 vars in 1254 bytes} [Thu Sep 1 14:08:31 2022] DELETE /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:08:31.885680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-aea022b1-5bc9-4164-8617-a792a2ee6672 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd4da160>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:31.941211 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-aea022b1-5bc9-4164-8617-a792a2ee6672 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406" status: 200 len: 286 microversion: 2.1 time: 0.060996 Sep 01 14:08:31.942014 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 517/1036] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 1 14:08:31 2022] GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:32.161050 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-08db134c-cdea-431d-acb5-f57374b0b221 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:32.161596 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-08db134c-cdea-431d-acb5-f57374b0b221 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:32.167624 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08db134c-cdea-431d-acb5-f57374b0b221 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:32.168109 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08db134c-cdea-431d-acb5-f57374b0b221 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:32.168548 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08db134c-cdea-431d-acb5-f57374b0b221 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:32.169235 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08db134c-cdea-431d-acb5-f57374b0b221 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:32.169696 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08db134c-cdea-431d-acb5-f57374b0b221 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:32.170154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08db134c-cdea-431d-acb5-f57374b0b221 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:32.258821 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-623f6f42-7400-40d1-a003-513d5e76be77 req-0cbf507e-0be8-4f23-93b9-498b43d9eeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7007a86d-dd1d-45fe-a163-9f3c5118e51b", "tag": "b3883027-3665-4906-802f-0c55de1ef651"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:32.269512 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-623f6f42-7400-40d1-a003-513d5e76be77 req-0cbf507e-0be8-4f23-93b9-498b43d9eeb3 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:32.270027 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-623f6f42-7400-40d1-a003-513d5e76be77 req-0cbf507e-0be8-4f23-93b9-498b43d9eeb3 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:32.270463 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-623f6f42-7400-40d1-a003-513d5e76be77 req-0cbf507e-0be8-4f23-93b9-498b43d9eeb3 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:32.282429 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-623f6f42-7400-40d1-a003-513d5e76be77 req-0cbf507e-0be8-4f23-93b9-498b43d9eeb3 service nova] Creating event network-changed:b3883027-3665-4906-802f-0c55de1ef651 for instance 7007a86d-dd1d-45fe-a163-9f3c5118e51b on hv-cinder-85221 Sep 01 14:08:32.287717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-623f6f42-7400-40d1-a003-513d5e76be77 req-0cbf507e-0be8-4f23-93b9-498b43d9eeb3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033412 Sep 01 14:08:32.296560 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 518/1037] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:08:32.402327 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-08db134c-cdea-431d-acb5-f57374b0b221 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:32.411208 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-08db134c-cdea-431d-acb5-f57374b0b221 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1278 microversion: 2.1 time: 0.254426 Sep 01 14:08:32.411729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 520/1038] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:32 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1278 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:32.956050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0041d6d4-2c76-4b98-918c-af251a570e05 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd81a040>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:32.985526 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-0041d6d4-2c76-4b98-918c-af251a570e05 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] HTTP exception thrown: Snapshot 7d7f8422-4332-48b5-b3a5-69d0457dc406 could not be found. Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0041d6d4-2c76-4b98-918c-af251a570e05 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Request method failure captured: Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406 HTTP/1.1 Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELzW5cfiBwI0i5sf3SSqYuLC9JbOs_0svI4mo2FjC3rTRe5Mw_X7_ABPT--66fmepp5THva0_tsXiB3myYPit1lyrUU04pynatU4mgM5A7HfAoQ0WuCJ8jgjI2MzUPxQRnA6qNZxcTPuW4eocxiqoR5Hqv8RMeGuFWqYPSxzTqN9HOg Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: a2a8b05bca8d4a30ad3286d5a10ad923 Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1647359902 Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:08:32.998615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:08:33.000271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2a8b05bca8d4a30ad3286d5a10ad923"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2a8b05bca8d4a30ad3286d5a10ad923"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2a8b05bca8d4a30ad3286d5a10ad923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2a8b05bca8d4a30ad3286d5a10ad923"}]}] Sep 01 14:08:33.000271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1647359902 Sep 01 14:08:33.000271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: a2a8b05bca8d4a30ad3286d5a10ad923 Sep 01 14:08:33.000271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1647359902 Sep 01 14:08:33.000271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-VolumesSnapshotsTestJSON-1647359902-project Sep 01 14:08:33.000271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:08:33.000271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:08:33.000271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 13f2f26e9daf416ba46371b5948ab743 Sep 01 14:08:33.000271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1647359902-project Sep 01 14:08:33.000271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: Sep 01 14:08:33.000271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Snapshot 7d7f8422-4332-48b5-b3a5-69d0457dc406 could not be found. Sep 01 14:08:33.000271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '7d7f8422-4332-48b5-b3a5-69d0457dc406'} Sep 01 14:08:33.000271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 7d7f8422-4332-48b5-b3a5-69d0457dc406 could not be found. (HTTP 404) (Request-ID: req-d9969932-d2c7-4c45-b8e5-62bedd4aca75) Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:33.001489 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:08:33.002935 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 7d7f8422-4332-48b5-b3a5-69d0457dc406 could not be found. Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 14:08:33.004939 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:33.006407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 7d7f8422-4332-48b5-b3a5-69d0457dc406 could not be found. Sep 01 14:08:33.006407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:33.006407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:33.006407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:33.006407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:33.006407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:33.006407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:33.006407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:33.006407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:33.006407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 7d7f8422-4332-48b5-b3a5-69d0457dc406 could not be found. Sep 01 14:08:33.006407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:33.006407 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0041d6d4-2c76-4b98-918c-af251a570e05 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Returning 404 to user: Snapshot 7d7f8422-4332-48b5-b3a5-69d0457dc406 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:33.007292 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0041d6d4-2c76-4b98-918c-af251a570e05 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406" status: 404 len: 111 microversion: 2.1 time: 0.053979 Sep 01 14:08:33.007958 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 519/1039] 10.222.0.61 () {58 vars in 1251 bytes} [Thu Sep 1 14:08:32 2022] GET /compute/v2.1/os-snapshots/7d7f8422-4332-48b5-b3a5-69d0457dc406 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:33.016455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cc354556-a9b1-4759-8bec-a5300861a1c0 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1b00c428b0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:33.359801 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cc354556-a9b1-4759-8bec-a5300861a1c0 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273" status: 202 len: 0 microversion: 2.1 time: 0.347123 Sep 01 14:08:33.360410 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 521/1040] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 1 14:08:33 2022] DELETE /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:08:33.365494 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:33.371132 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b8f6499e-c009-4c8d-ac2c-ba29f37c6efe tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd59c820>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:33.421515 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b8f6499e-c009-4c8d-ac2c-ba29f37c6efe tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273" status: 200 len: 344 microversion: 2.1 time: 0.056736 Sep 01 14:08:33.422130 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 520/1041] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:08:33 2022] GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:08:33.434140 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c0a4c87c-7d7e-444e-9c0a-c6ad85208be3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:33.434850 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c0a4c87c-7d7e-444e-9c0a-c6ad85208be3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:33.441499 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0a4c87c-7d7e-444e-9c0a-c6ad85208be3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:33.442773 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0a4c87c-7d7e-444e-9c0a-c6ad85208be3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:33.442773 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0a4c87c-7d7e-444e-9c0a-c6ad85208be3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:33.443297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0a4c87c-7d7e-444e-9c0a-c6ad85208be3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:33.443779 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0a4c87c-7d7e-444e-9c0a-c6ad85208be3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:33.444214 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c0a4c87c-7d7e-444e-9c0a-c6ad85208be3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:33.581134 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c0a4c87c-7d7e-444e-9c0a-c6ad85208be3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:33.589449 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c0a4c87c-7d7e-444e-9c0a-c6ad85208be3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1266 microversion: 2.1 time: 0.160148 Sep 01 14:08:33.590028 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 522/1042] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:33 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:34.436682 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e4985e30-62bd-475e-8388-0bcea23f61e0 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd1f0670>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:34.490657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e4985e30-62bd-475e-8388-0bcea23f61e0 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273" status: 200 len: 344 microversion: 2.1 time: 0.054656 Sep 01 14:08:34.490657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 521/1043] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:08:34 2022] GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:34.612673 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7d4eb9a0-93be-4c36-b487-221cc39c4612 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:34.613294 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7d4eb9a0-93be-4c36-b487-221cc39c4612 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:34.620760 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7d4eb9a0-93be-4c36-b487-221cc39c4612 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:34.621253 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7d4eb9a0-93be-4c36-b487-221cc39c4612 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:34.621689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7d4eb9a0-93be-4c36-b487-221cc39c4612 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:34.622431 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7d4eb9a0-93be-4c36-b487-221cc39c4612 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:34.622897 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7d4eb9a0-93be-4c36-b487-221cc39c4612 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:34.623317 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7d4eb9a0-93be-4c36-b487-221cc39c4612 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:34.772157 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7d4eb9a0-93be-4c36-b487-221cc39c4612 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:34.780300 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7d4eb9a0-93be-4c36-b487-221cc39c4612 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1266 microversion: 2.1 time: 0.172574 Sep 01 14:08:34.780877 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 523/1044] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:34 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:35.497296 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=10 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:35.501790 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-dbe56fca-73a8-4fb2-8810-6ce21b8e9cd5 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd6b0d30>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:35.552819 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-dbe56fca-73a8-4fb2-8810-6ce21b8e9cd5 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273" status: 200 len: 344 microversion: 2.1 time: 0.056065 Sep 01 14:08:35.553401 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 522/1045] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:08:35 2022] GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:35.800412 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-35f8d9b1-6888-4cf1-9dc0-cd5804e45906 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:35.801028 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-35f8d9b1-6888-4cf1-9dc0-cd5804e45906 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:35.808219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-35f8d9b1-6888-4cf1-9dc0-cd5804e45906 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:35.808703 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-35f8d9b1-6888-4cf1-9dc0-cd5804e45906 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:35.809822 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-35f8d9b1-6888-4cf1-9dc0-cd5804e45906 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:35.809983 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-35f8d9b1-6888-4cf1-9dc0-cd5804e45906 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:35.810353 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-35f8d9b1-6888-4cf1-9dc0-cd5804e45906 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:35.810804 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-35f8d9b1-6888-4cf1-9dc0-cd5804e45906 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:35.951281 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-35f8d9b1-6888-4cf1-9dc0-cd5804e45906 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:35.958950 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-35f8d9b1-6888-4cf1-9dc0-cd5804e45906 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1266 microversion: 2.1 time: 0.162406 Sep 01 14:08:35.959503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 524/1046] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:35 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:36.317743 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-68f5fd52-71c2-4f45-bd98-b42f41de3dce tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:36.320162 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-68f5fd52-71c2-4f45-bd98-b42f41de3dce tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:36.329241 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-68f5fd52-71c2-4f45-bd98-b42f41de3dce tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:36.329734 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-68f5fd52-71c2-4f45-bd98-b42f41de3dce tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:36.330209 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-68f5fd52-71c2-4f45-bd98-b42f41de3dce tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:36.330915 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-68f5fd52-71c2-4f45-bd98-b42f41de3dce tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:36.331384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-68f5fd52-71c2-4f45-bd98-b42f41de3dce tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:36.331807 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-68f5fd52-71c2-4f45-bd98-b42f41de3dce tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:36.362865 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-68f5fd52-71c2-4f45-bd98-b42f41de3dce tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049824 Sep 01 14:08:36.363450 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 523/1047] 10.222.0.61 () {60 vars in 1343 bytes} [Thu Sep 1 14:08:36 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:36.428955 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ee5b7168-1c51-447d-b043-9ce18785b753 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:36.429946 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ee5b7168-1c51-447d-b043-9ce18785b753 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:36.436230 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ee5b7168-1c51-447d-b043-9ce18785b753 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:36.436778 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ee5b7168-1c51-447d-b043-9ce18785b753 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:36.437264 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ee5b7168-1c51-447d-b043-9ce18785b753 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:36.452956 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ee5b7168-1c51-447d-b043-9ce18785b753 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:36.452956 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ee5b7168-1c51-447d-b043-9ce18785b753 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:36.452956 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ee5b7168-1c51-447d-b043-9ce18785b753 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:36.467635 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ee5b7168-1c51-447d-b043-9ce18785b753 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Going to try to terminate instance {{(pid=127811) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:08:36.566281 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b14d2f4f-7e44-4364-9be1-638adfef9c6e tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd210e50>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:36.615526 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b14d2f4f-7e44-4364-9be1-638adfef9c6e tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273" status: 200 len: 344 microversion: 2.1 time: 0.052958 Sep 01 14:08:36.616108 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 524/1048] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:08:36 2022] GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:08:36.776303 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:08:36.979527 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e0d932e3-e82c-4bcb-af96-5f0325a00ae9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:36.980191 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e0d932e3-e82c-4bcb-af96-5f0325a00ae9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:36.986077 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e0d932e3-e82c-4bcb-af96-5f0325a00ae9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:36.986557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e0d932e3-e82c-4bcb-af96-5f0325a00ae9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:36.986991 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e0d932e3-e82c-4bcb-af96-5f0325a00ae9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:36.987686 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e0d932e3-e82c-4bcb-af96-5f0325a00ae9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:36.988133 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e0d932e3-e82c-4bcb-af96-5f0325a00ae9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:36.988567 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e0d932e3-e82c-4bcb-af96-5f0325a00ae9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:37.114454 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ee5b7168-1c51-447d-b043-9ce18785b753 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 204 len: 0 microversion: 2.20 time: 0.689055 Sep 01 14:08:37.116429 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 525/1049] 10.222.0.61 () {60 vars in 1280 bytes} [Thu Sep 1 14:08:36 2022] DELETE /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 14:08:37.129619 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d5791ecc-86ca-4851-ba14-ceaeaf3ea0c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:37.129619 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d5791ecc-86ca-4851-ba14-ceaeaf3ea0c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:37.134665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5791ecc-86ca-4851-ba14-ceaeaf3ea0c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:37.135075 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e0d932e3-e82c-4bcb-af96-5f0325a00ae9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:37.135453 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5791ecc-86ca-4851-ba14-ceaeaf3ea0c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:37.135884 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5791ecc-86ca-4851-ba14-ceaeaf3ea0c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:37.136969 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5791ecc-86ca-4851-ba14-ceaeaf3ea0c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:37.137657 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5791ecc-86ca-4851-ba14-ceaeaf3ea0c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:37.138297 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5791ecc-86ca-4851-ba14-ceaeaf3ea0c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:37.149247 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e0d932e3-e82c-4bcb-af96-5f0325a00ae9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1266 microversion: 2.1 time: 0.173602 Sep 01 14:08:37.150255 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 525/1050] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:36 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:37.304019 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d5791ecc-86ca-4851-ba14-ceaeaf3ea0c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:37.318402 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d5791ecc-86ca-4851-ba14-ceaeaf3ea0c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:37.319592 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d5791ecc-86ca-4851-ba14-ceaeaf3ea0c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:37.320826 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d5791ecc-86ca-4851-ba14-ceaeaf3ea0c9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.199482 Sep 01 14:08:37.321567 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 526/1051] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:37 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:37.629486 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a6044f8f-4a3a-4edc-b0be-e3bbb50da12e tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd78d9d0>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:37.738065 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-a6044f8f-4a3a-4edc-b0be-e3bbb50da12e tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] HTTP exception thrown: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a6044f8f-4a3a-4edc-b0be-e3bbb50da12e tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Request method failure captured: Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273 HTTP/1.1 Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELzW5cfiBwI0i5sf3SSqYuLC9JbOs_0svI4mo2FjC3rTRe5Mw_X7_ABPT--66fmepp5THva0_tsXiB3myYPit1lyrUU04pynatU4mgM5A7HfAoQ0WuCJ8jgjI2MzUPxQRnA6qNZxcTPuW4eocxiqoR5Hqv8RMeGuFWqYPSxzTqN9HOg Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: a2a8b05bca8d4a30ad3286d5a10ad923 Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1647359902 Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:08:37.740584 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:08:37.742905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2a8b05bca8d4a30ad3286d5a10ad923"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2a8b05bca8d4a30ad3286d5a10ad923"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2a8b05bca8d4a30ad3286d5a10ad923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2a8b05bca8d4a30ad3286d5a10ad923"}]}] Sep 01 14:08:37.742905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1647359902 Sep 01 14:08:37.742905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: a2a8b05bca8d4a30ad3286d5a10ad923 Sep 01 14:08:37.742905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1647359902 Sep 01 14:08:37.742905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-VolumesSnapshotsTestJSON-1647359902-project Sep 01 14:08:37.742905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:08:37.742905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:08:37.742905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 13f2f26e9daf416ba46371b5948ab743 Sep 01 14:08:37.742905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1647359902-project Sep 01 14:08:37.742905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: Sep 01 14:08:37.742905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.742905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '1dc9b421-8bfe-4fc7-8641-af6356b0c273'} Sep 01 14:08:37.742905 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. (HTTP 404) (Request-ID: req-7511c5e2-ca4c-463b-a8a5-2ef272e5347b) Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:37.744037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:08:37.745258 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 14:08:37.747384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a6044f8f-4a3a-4edc-b0be-e3bbb50da12e tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Returning 404 to user: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a6044f8f-4a3a-4edc-b0be-e3bbb50da12e tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273" status: 404 len: 109 microversion: 2.1 time: 0.116652 Sep 01 14:08:37.749656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 526/1052] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:08:37 2022] GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:37.753907 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b1294688-85f7-4ff6-931b-01038f3d9b88 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1b00c621f0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:37.785661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-b1294688-85f7-4ff6-931b-01038f3d9b88 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] HTTP exception thrown: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b1294688-85f7-4ff6-931b-01038f3d9b88 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Request method failure captured: Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: DELETE /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273 HTTP/1.1 Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELzW5cfiBwI0i5sf3SSqYuLC9JbOs_0svI4mo2FjC3rTRe5Mw_X7_ABPT--66fmepp5THva0_tsXiB3myYPit1lyrUU04pynatU4mgM5A7HfAoQ0WuCJ8jgjI2MzUPxQRnA6qNZxcTPuW4eocxiqoR5Hqv8RMeGuFWqYPSxzTqN9HOg Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: a2a8b05bca8d4a30ad3286d5a10ad923 Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1647359902 Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:08:37.789153 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:08:37.790622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2a8b05bca8d4a30ad3286d5a10ad923"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2a8b05bca8d4a30ad3286d5a10ad923"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2a8b05bca8d4a30ad3286d5a10ad923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2a8b05bca8d4a30ad3286d5a10ad923"}]}] Sep 01 14:08:37.790622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1647359902 Sep 01 14:08:37.790622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: a2a8b05bca8d4a30ad3286d5a10ad923 Sep 01 14:08:37.790622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1647359902 Sep 01 14:08:37.790622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-VolumesSnapshotsTestJSON-1647359902-project Sep 01 14:08:37.790622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:08:37.790622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:08:37.790622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 13f2f26e9daf416ba46371b5948ab743 Sep 01 14:08:37.790622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1647359902-project Sep 01 14:08:37.790622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: Sep 01 14:08:37.790622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.790622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '1dc9b421-8bfe-4fc7-8641-af6356b0c273'} Sep 01 14:08:37.790622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. (HTTP 404) (Request-ID: req-f4074efc-006e-4c25-8a11-2fab7659db62) Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:37.792130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 14:08:37.793738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 14:08:37.795809 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:37.798680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.798680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.798680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:37.798680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.798680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:37.798680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:37.798680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:37.798680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:37.798680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:37.798680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.798680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.798680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b1294688-85f7-4ff6-931b-01038f3d9b88 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Returning 404 to user: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:37.798680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b1294688-85f7-4ff6-931b-01038f3d9b88 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273" status: 404 len: 109 microversion: 2.1 time: 0.040908 Sep 01 14:08:37.799659 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 527/1053] 10.222.0.61 () {58 vars in 1248 bytes} [Thu Sep 1 14:08:37 2022] DELETE /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:37.799755 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6afc7dce-6611-486c-b1b4-6749ff935233 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Calling method '.version_select at 0x7f1afd4e6dc0>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:37.832238 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-6afc7dce-6611-486c-b1b4-6749ff935233 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] HTTP exception thrown: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6afc7dce-6611-486c-b1b4-6749ff935233 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Request method failure captured: Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273 HTTP/1.1 Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELzW5cfiBwI0i5sf3SSqYuLC9JbOs_0svI4mo2FjC3rTRe5Mw_X7_ABPT--66fmepp5THva0_tsXiB3myYPit1lyrUU04pynatU4mgM5A7HfAoQ0WuCJ8jgjI2MzUPxQRnA6qNZxcTPuW4eocxiqoR5Hqv8RMeGuFWqYPSxzTqN9HOg Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: a2a8b05bca8d4a30ad3286d5a10ad923 Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1647359902 Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:08:37.834796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:08:37.836559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2a8b05bca8d4a30ad3286d5a10ad923"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2a8b05bca8d4a30ad3286d5a10ad923"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2a8b05bca8d4a30ad3286d5a10ad923"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2a8b05bca8d4a30ad3286d5a10ad923"}]}] Sep 01 14:08:37.836559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1647359902 Sep 01 14:08:37.836559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: a2a8b05bca8d4a30ad3286d5a10ad923 Sep 01 14:08:37.836559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1647359902 Sep 01 14:08:37.836559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-VolumesSnapshotsTestJSON-1647359902-project Sep 01 14:08:37.836559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:08:37.836559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:08:37.836559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 13f2f26e9daf416ba46371b5948ab743 Sep 01 14:08:37.836559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1647359902-project Sep 01 14:08:37.836559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: Sep 01 14:08:37.836559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.836559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '1dc9b421-8bfe-4fc7-8641-af6356b0c273'} Sep 01 14:08:37.836559 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. (HTTP 404) (Request-ID: req-e3f55a85-54a1-4f9f-b3ae-cd3a29150921) Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:37.838180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 14:08:37.839577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 14:08:37.841134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6afc7dce-6611-486c-b1b4-6749ff935233 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] Returning 404 to user: Volume 1dc9b421-8bfe-4fc7-8641-af6356b0c273 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6afc7dce-6611-486c-b1b4-6749ff935233 tempest-VolumesSnapshotsTestJSON-1647359902 tempest-VolumesSnapshotsTestJSON-1647359902-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273" status: 404 len: 109 microversion: 2.1 time: 0.041692 Sep 01 14:08:37.842557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 527/1054] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:08:37 2022] GET /compute/v2.1/os-volumes/1dc9b421-8bfe-4fc7-8641-af6356b0c273 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:08:38.172575 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-29a9b092-564a-43aa-97cd-53629751e0b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:38.173195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-29a9b092-564a-43aa-97cd-53629751e0b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:38.179986 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-29a9b092-564a-43aa-97cd-53629751e0b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:38.180525 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-29a9b092-564a-43aa-97cd-53629751e0b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:38.180964 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-29a9b092-564a-43aa-97cd-53629751e0b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:38.181665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-29a9b092-564a-43aa-97cd-53629751e0b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:38.182143 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-29a9b092-564a-43aa-97cd-53629751e0b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:38.182571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-29a9b092-564a-43aa-97cd-53629751e0b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:38.326724 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-29a9b092-564a-43aa-97cd-53629751e0b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:38.342643 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-29a9b092-564a-43aa-97cd-53629751e0b0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1266 microversion: 2.1 time: 0.168384 Sep 01 14:08:38.343699 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 528/1055] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:38 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:38.357114 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0420c249-ef7f-4b84-b1a3-34d5e6c4c53e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:38.357728 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-0420c249-ef7f-4b84-b1a3-34d5e6c4c53e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:38.363918 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0420c249-ef7f-4b84-b1a3-34d5e6c4c53e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:38.364415 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0420c249-ef7f-4b84-b1a3-34d5e6c4c53e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:38.364852 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0420c249-ef7f-4b84-b1a3-34d5e6c4c53e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:38.365599 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0420c249-ef7f-4b84-b1a3-34d5e6c4c53e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:38.366089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0420c249-ef7f-4b84-b1a3-34d5e6c4c53e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:38.366538 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-0420c249-ef7f-4b84-b1a3-34d5e6c4c53e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:38.509987 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0420c249-ef7f-4b84-b1a3-34d5e6c4c53e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:38.517413 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0420c249-ef7f-4b84-b1a3-34d5e6c4c53e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:38.519105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-0420c249-ef7f-4b84-b1a3-34d5e6c4c53e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:38.520226 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0420c249-ef7f-4b84-b1a3-34d5e6c4c53e tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.169175 Sep 01 14:08:38.520966 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 528/1056] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:38 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:39.362876 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-611b71b3-3099-4c1f-b698-3d1079877aaa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:39.364392 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-611b71b3-3099-4c1f-b698-3d1079877aaa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:39.375922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-611b71b3-3099-4c1f-b698-3d1079877aaa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:39.376551 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-611b71b3-3099-4c1f-b698-3d1079877aaa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:39.377077 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-611b71b3-3099-4c1f-b698-3d1079877aaa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:39.377927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-611b71b3-3099-4c1f-b698-3d1079877aaa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:39.378726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-611b71b3-3099-4c1f-b698-3d1079877aaa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:39.379251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-611b71b3-3099-4c1f-b698-3d1079877aaa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:39.545394 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6cd43a43-a447-4ae5-8bbc-64102a75e50f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:39.546491 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-6cd43a43-a447-4ae5-8bbc-64102a75e50f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:39.558381 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6cd43a43-a447-4ae5-8bbc-64102a75e50f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:39.559208 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6cd43a43-a447-4ae5-8bbc-64102a75e50f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:39.560748 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6cd43a43-a447-4ae5-8bbc-64102a75e50f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:39.563530 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6cd43a43-a447-4ae5-8bbc-64102a75e50f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:39.564328 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6cd43a43-a447-4ae5-8bbc-64102a75e50f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:39.565613 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6cd43a43-a447-4ae5-8bbc-64102a75e50f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:39.705989 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-611b71b3-3099-4c1f-b698-3d1079877aaa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:39.715017 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-611b71b3-3099-4c1f-b698-3d1079877aaa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1266 microversion: 2.1 time: 0.357097 Sep 01 14:08:39.715899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 529/1057] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:39 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:39.861761 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-6cd43a43-a447-4ae5-8bbc-64102a75e50f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:39.875672 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-6cd43a43-a447-4ae5-8bbc-64102a75e50f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:39.877982 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-6cd43a43-a447-4ae5-8bbc-64102a75e50f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:39.880321 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6cd43a43-a447-4ae5-8bbc-64102a75e50f tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1723 microversion: 2.20 time: 0.339226 Sep 01 14:08:39.881214 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 529/1058] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:39 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:40.736679 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-03d07d08-72dc-4aed-84ee-9fde845bd87b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:40.737335 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-03d07d08-72dc-4aed-84ee-9fde845bd87b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:40.744853 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-03d07d08-72dc-4aed-84ee-9fde845bd87b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:40.745517 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-03d07d08-72dc-4aed-84ee-9fde845bd87b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:40.746258 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-03d07d08-72dc-4aed-84ee-9fde845bd87b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:40.747068 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-03d07d08-72dc-4aed-84ee-9fde845bd87b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:40.747776 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-03d07d08-72dc-4aed-84ee-9fde845bd87b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:40.748265 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-03d07d08-72dc-4aed-84ee-9fde845bd87b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:40.877410 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-bc4545c1-6747-4190-a9ce-f110d146b0cf req-73de515e-5257-4409-8a20-64f1b700fe76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacf49fd-7b35-4e19-81f0-098fc9d2b0d6", "name": "network-vif-deleted", "tag": "fce10985-ae68-4e7b-beef-fef3f597b453"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:40.891577 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-bc4545c1-6747-4190-a9ce-f110d146b0cf req-73de515e-5257-4409-8a20-64f1b700fe76 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:40.892562 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-bc4545c1-6747-4190-a9ce-f110d146b0cf req-73de515e-5257-4409-8a20-64f1b700fe76 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:40.894115 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-bc4545c1-6747-4190-a9ce-f110d146b0cf req-73de515e-5257-4409-8a20-64f1b700fe76 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:40.909963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-bc4545c1-6747-4190-a9ce-f110d146b0cf req-73de515e-5257-4409-8a20-64f1b700fe76 service nova] Creating event network-vif-deleted:fce10985-ae68-4e7b-beef-fef3f597b453 for instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 on hv-cinder-85221 Sep 01 14:08:40.916599 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-bc4545c1-6747-4190-a9ce-f110d146b0cf req-73de515e-5257-4409-8a20-64f1b700fe76 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042881 Sep 01 14:08:40.922998 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 530/1059] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:08:40.928360 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-81bc20b5-8794-474a-9519-0c0bfe918d6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:40.929596 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-81bc20b5-8794-474a-9519-0c0bfe918d6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:40.937079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81bc20b5-8794-474a-9519-0c0bfe918d6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:40.937742 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81bc20b5-8794-474a-9519-0c0bfe918d6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:40.938657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81bc20b5-8794-474a-9519-0c0bfe918d6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:40.939535 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81bc20b5-8794-474a-9519-0c0bfe918d6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:40.940268 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81bc20b5-8794-474a-9519-0c0bfe918d6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:40.940888 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-81bc20b5-8794-474a-9519-0c0bfe918d6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:41.003254 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-03d07d08-72dc-4aed-84ee-9fde845bd87b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:41.018047 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-03d07d08-72dc-4aed-84ee-9fde845bd87b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1266 microversion: 2.1 time: 0.284843 Sep 01 14:08:41.019847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 530/1060] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:40 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:41.021846 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-81bc20b5-8794-474a-9519-0c0bfe918d6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:41.032066 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-81bc20b5-8794-474a-9519-0c0bfe918d6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:41.033521 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-81bc20b5-8794-474a-9519-0c0bfe918d6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:41.034729 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-81bc20b5-8794-474a-9519-0c0bfe918d6c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1656 microversion: 2.20 time: 0.110555 Sep 01 14:08:41.048851 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 531/1061] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:40 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1656 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:42.041448 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-fddd3e8a-e44e-4579-a175-62c4c31e24cb tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:42.042104 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-fddd3e8a-e44e-4579-a175-62c4c31e24cb tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:42.050228 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fddd3e8a-e44e-4579-a175-62c4c31e24cb tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:42.050735 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fddd3e8a-e44e-4579-a175-62c4c31e24cb tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:42.051172 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fddd3e8a-e44e-4579-a175-62c4c31e24cb tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:42.053239 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fddd3e8a-e44e-4579-a175-62c4c31e24cb tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:42.053239 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fddd3e8a-e44e-4579-a175-62c4c31e24cb tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:42.053239 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-fddd3e8a-e44e-4579-a175-62c4c31e24cb tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:42.059114 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:42.059823 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:42.074101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:42.074936 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:42.075699 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:42.076536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:42.078953 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:42.079643 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:42.154849 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:42.155645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:42.156354 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:42.157083 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lazy-loading 'fault' on Instance uuid aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:08:42.230299 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:42.243673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:42.245549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b77f38582b8842d7a303e8431299191a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e322f2f7da74039aff258b70af12095', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:42.246812 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-813cb570-d0ff-4be7-a992-1ed827a495b0 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 200 len: 1372 microversion: 2.20 time: 0.192064 Sep 01 14:08:42.247757 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 532/1062] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:42 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 1372 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 14:08:42.269296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-fddd3e8a-e44e-4579-a175-62c4c31e24cb tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:42.288893 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-fddd3e8a-e44e-4579-a175-62c4c31e24cb tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1266 microversion: 2.1 time: 0.251222 Sep 01 14:08:42.289641 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 531/1063] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:42 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:08:43.270281 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b118991a-d32a-4d31-859a-740f6187c4be tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:43.270885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b118991a-d32a-4d31-859a-740f6187c4be tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:43.277844 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b118991a-d32a-4d31-859a-740f6187c4be tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:43.278334 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b118991a-d32a-4d31-859a-740f6187c4be tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:43.286484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b118991a-d32a-4d31-859a-740f6187c4be tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:43.286484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b118991a-d32a-4d31-859a-740f6187c4be tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:43.286484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b118991a-d32a-4d31-859a-740f6187c4be tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:43.286484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b118991a-d32a-4d31-859a-740f6187c4be tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:43.295593 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-b118991a-d32a-4d31-859a-740f6187c4be tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] HTTP exception thrown: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b118991a-d32a-4d31-859a-740f6187c4be tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Request method failure captured: Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 HTTP/1.1 Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsRog0CJcPYnwKv9f7xm92IKcNoh3D-IsG2eJ_g95XfMwbEzqe6qSgkUC49ZfLMbsozlxZr_m5SK4mQF02vH2pUSppg1b36GgCvg3sxnDTAol7C6owTWp71mXhbSMEs0yIFn0AoHHVgPfJ4CoxFI2ceHMBsZdCF53XnoWNesf4GIMQ Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 7e322f2f7da74039aff258b70af12095 Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:08:43.297270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:08:43.299197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7e322f2f7da74039aff258b70af12095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7e322f2f7da74039aff258b70af12095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7e322f2f7da74039aff258b70af12095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7e322f2f7da74039aff258b70af12095"}]}] Sep 01 14:08:43.299197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:43.299197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 7e322f2f7da74039aff258b70af12095 Sep 01 14:08:43.299197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:43.299197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-AttachVolumeShelveTestJSON-1921641283-project Sep 01 14:08:43.299197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:08:43.299197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:08:43.299197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: b77f38582b8842d7a303e8431299191a Sep 01 14:08:43.299197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1921641283-project Sep 01 14:08:43.299197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:08:43.299197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:43.299197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': 'aacf49fd-7b35-4e19-81f0-098fc9d2b0d6'} Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:43.300669 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:43.301988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:43.304993 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b118991a-d32a-4d31-859a-740f6187c4be tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Returning 404 to user: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:43.304993 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b118991a-d32a-4d31-859a-740f6187c4be tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 404 len: 111 microversion: 2.20 time: 0.032202 Sep 01 14:08:43.304993 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 533/1064] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:43 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:08:43.307502 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-73bba2eb-af7f-4ffc-8f2b-497bf75750a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '.version_select at 0x7f1b00ca3700>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:43.317455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a572e35f-38a2-45b4-a72d-2eb38148937b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:43.318107 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a572e35f-38a2-45b4-a72d-2eb38148937b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:43.324763 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a572e35f-38a2-45b4-a72d-2eb38148937b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:43.331945 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a572e35f-38a2-45b4-a72d-2eb38148937b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:43.332413 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a572e35f-38a2-45b4-a72d-2eb38148937b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:43.333243 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a572e35f-38a2-45b4-a72d-2eb38148937b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:43.333670 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a572e35f-38a2-45b4-a72d-2eb38148937b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:43.334196 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a572e35f-38a2-45b4-a72d-2eb38148937b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:43.480430 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a572e35f-38a2-45b4-a72d-2eb38148937b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:43.488293 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a572e35f-38a2-45b4-a72d-2eb38148937b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1266 microversion: 2.1 time: 0.174651 Sep 01 14:08:43.488882 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 534/1065] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:43 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:43.578459 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-73bba2eb-af7f-4ffc-8f2b-497bf75750a9 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066164268" status: 204 len: 0 microversion: 2.20 time: 0.274673 Sep 01 14:08:43.579051 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 532/1066] 10.222.0.61 () {60 vars in 1262 bytes} [Thu Sep 1 14:08:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1066164268 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 14:08:44.387250 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-af10051d-e687-4efa-8136-5fe119d17a67 req-52b99782-0dc8-421d-ba3d-8e341ef09bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7007a86d-dd1d-45fe-a163-9f3c5118e51b", "name": "network-vif-plugged", "status": "completed", "tag": "b3883027-3665-4906-802f-0c55de1ef651"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:44.399775 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-af10051d-e687-4efa-8136-5fe119d17a67 req-52b99782-0dc8-421d-ba3d-8e341ef09bd8 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:44.400520 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-af10051d-e687-4efa-8136-5fe119d17a67 req-52b99782-0dc8-421d-ba3d-8e341ef09bd8 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:44.401050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-af10051d-e687-4efa-8136-5fe119d17a67 req-52b99782-0dc8-421d-ba3d-8e341ef09bd8 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:44.415099 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-af10051d-e687-4efa-8136-5fe119d17a67 req-52b99782-0dc8-421d-ba3d-8e341ef09bd8 service nova] Creating event network-vif-plugged:b3883027-3665-4906-802f-0c55de1ef651 for instance 7007a86d-dd1d-45fe-a163-9f3c5118e51b on hv-cinder-85221 Sep 01 14:08:44.420088 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-af10051d-e687-4efa-8136-5fe119d17a67 req-52b99782-0dc8-421d-ba3d-8e341ef09bd8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038622 Sep 01 14:08:44.421365 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 535/1067] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:08:44.509997 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2bdb8fb3-7b56-4b3c-ba7e-f559d20ac055 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:44.510661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2bdb8fb3-7b56-4b3c-ba7e-f559d20ac055 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:44.520618 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2bdb8fb3-7b56-4b3c-ba7e-f559d20ac055 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:44.521408 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2bdb8fb3-7b56-4b3c-ba7e-f559d20ac055 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:44.521926 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2bdb8fb3-7b56-4b3c-ba7e-f559d20ac055 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:44.522845 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2bdb8fb3-7b56-4b3c-ba7e-f559d20ac055 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:44.523329 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2bdb8fb3-7b56-4b3c-ba7e-f559d20ac055 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:44.523747 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2bdb8fb3-7b56-4b3c-ba7e-f559d20ac055 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:44.779249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2bdb8fb3-7b56-4b3c-ba7e-f559d20ac055 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:44.788543 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2bdb8fb3-7b56-4b3c-ba7e-f559d20ac055 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1266 microversion: 2.1 time: 0.283542 Sep 01 14:08:44.795667 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 533/1068] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:44 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:45.287962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-77dc9fe1-1d9d-4dc4-83ee-47bdd0afbf46 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] Calling method '.version_select at 0x7f1afd78dd30>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:45.343437 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-77dc9fe1-1d9d-4dc4-83ee-47bdd0afbf46 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/e63450be-67f1-4ef7-9120-a4108cecc9c6" status: 200 len: 350 microversion: 2.1 time: 0.068444 Sep 01 14:08:45.344009 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 536/1069] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:08:45 2022] GET /compute/v2.1/os-volumes/e63450be-67f1-4ef7-9120-a4108cecc9c6 => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:45.814845 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-567a1fb3-683a-4b07-a19d-2e3f8099c080 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:45.815439 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-567a1fb3-683a-4b07-a19d-2e3f8099c080 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:45.822465 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-567a1fb3-683a-4b07-a19d-2e3f8099c080 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:45.822945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-567a1fb3-683a-4b07-a19d-2e3f8099c080 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:45.823379 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-567a1fb3-683a-4b07-a19d-2e3f8099c080 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:45.824061 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-567a1fb3-683a-4b07-a19d-2e3f8099c080 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:45.824512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-567a1fb3-683a-4b07-a19d-2e3f8099c080 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:45.824930 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-567a1fb3-683a-4b07-a19d-2e3f8099c080 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:45.959052 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-567a1fb3-683a-4b07-a19d-2e3f8099c080 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:45.967463 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-567a1fb3-683a-4b07-a19d-2e3f8099c080 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1266 microversion: 2.1 time: 0.156492 Sep 01 14:08:45.968026 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 534/1070] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:45 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:46.347141 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-dbf7887a-dfe4-4157-b70e-f8576d9e131c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:46.347828 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-dbf7887a-dfe4-4157-b70e-f8576d9e131c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:46.354202 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dbf7887a-dfe4-4157-b70e-f8576d9e131c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:46.354687 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dbf7887a-dfe4-4157-b70e-f8576d9e131c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:46.355149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dbf7887a-dfe4-4157-b70e-f8576d9e131c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:46.355852 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dbf7887a-dfe4-4157-b70e-f8576d9e131c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:46.356311 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dbf7887a-dfe4-4157-b70e-f8576d9e131c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:46.356740 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dbf7887a-dfe4-4157-b70e-f8576d9e131c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:46.370820 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-dbf7887a-dfe4-4157-b70e-f8576d9e131c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] HTTP exception thrown: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-dbf7887a-dfe4-4157-b70e-f8576d9e131c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Request method failure captured: Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: DELETE /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 HTTP/1.1 Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsRog0CJcPYnwKv9f7xm92IKcNoh3D-IsG2eJ_g95XfMwbEzqe6qSgkUC49ZfLMbsozlxZr_m5SK4mQF02vH2pUSppg1b36GgCvg3sxnDTAol7C6owTWp71mXhbSMEs0yIFn0AoHHVgPfJ4CoxFI2ceHMBsZdCF53XnoWNesf4GIMQ Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 7e322f2f7da74039aff258b70af12095 Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:08:46.372509 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:08:46.375110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7e322f2f7da74039aff258b70af12095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7e322f2f7da74039aff258b70af12095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7e322f2f7da74039aff258b70af12095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7e322f2f7da74039aff258b70af12095"}]}] Sep 01 14:08:46.375110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:46.375110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 7e322f2f7da74039aff258b70af12095 Sep 01 14:08:46.375110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:46.375110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-AttachVolumeShelveTestJSON-1921641283-project Sep 01 14:08:46.375110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:08:46.375110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:08:46.375110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: b77f38582b8842d7a303e8431299191a Sep 01 14:08:46.375110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1921641283-project Sep 01 14:08:46.375110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:08:46.375110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:46.375110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': 'aacf49fd-7b35-4e19-81f0-098fc9d2b0d6'} Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:46.376444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:46.379239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:46.381379 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-dbf7887a-dfe4-4157-b70e-f8576d9e131c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Returning 404 to user: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:46.381379 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-dbf7887a-dfe4-4157-b70e-f8576d9e131c tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "DELETE /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 404 len: 111 microversion: 2.20 time: 0.031176 Sep 01 14:08:46.381379 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 537/1071] 10.222.0.61 () {60 vars in 1280 bytes} [Thu Sep 1 14:08:46 2022] DELETE /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:08:46.383760 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-bc5c7dfe-b180-47e0-b3c8-79f475be96e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:46.384363 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-bc5c7dfe-b180-47e0-b3c8-79f475be96e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: aacf49fd-7b35-4e19-81f0-098fc9d2b0d6] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:46.390275 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bc5c7dfe-b180-47e0-b3c8-79f475be96e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:46.390760 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bc5c7dfe-b180-47e0-b3c8-79f475be96e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:46.391198 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bc5c7dfe-b180-47e0-b3c8-79f475be96e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:46.392076 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bc5c7dfe-b180-47e0-b3c8-79f475be96e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:46.429908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bc5c7dfe-b180-47e0-b3c8-79f475be96e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:46.429908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-bc5c7dfe-b180-47e0-b3c8-79f475be96e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:46.429908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-bc5c7dfe-b180-47e0-b3c8-79f475be96e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] HTTP exception thrown: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:46.429908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-bc5c7dfe-b180-47e0-b3c8-79f475be96e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Request method failure captured: Sep 01 14:08:46.429908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 HTTP/1.1 Sep 01 14:08:46.429908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:08:46.429908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:08:46.429908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:08:46.429908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:08:46.429908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:08:46.429908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:08:46.429908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:08:46.429908 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsRog0CJcPYnwKv9f7xm92IKcNoh3D-IsG2eJ_g95XfMwbEzqe6qSgkUC49ZfLMbsozlxZr_m5SK4mQF02vH2pUSppg1b36GgCvg3sxnDTAol7C6owTWp71mXhbSMEs0yIFn0AoHHVgPfJ4CoxFI2ceHMBsZdCF53XnoWNesf4GIMQ Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 7e322f2f7da74039aff258b70af12095 Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7e322f2f7da74039aff258b70af12095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7e322f2f7da74039aff258b70af12095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7e322f2f7da74039aff258b70af12095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7e322f2f7da74039aff258b70af12095"}]}] Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:46.431185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 7e322f2f7da74039aff258b70af12095 Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-AttachVolumeShelveTestJSON-1921641283-project Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: b77f38582b8842d7a303e8431299191a Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1921641283-project Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': 'aacf49fd-7b35-4e19-81f0-098fc9d2b0d6'} Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:46.432504 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:46.434613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:46.436201 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:46.436201 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. Sep 01 14:08:46.436201 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:46.436201 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-bc5c7dfe-b180-47e0-b3c8-79f475be96e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Returning 404 to user: Instance aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:46.436201 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-bc5c7dfe-b180-47e0-b3c8-79f475be96e7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6" status: 404 len: 111 microversion: 2.20 time: 0.032293 Sep 01 14:08:46.436201 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 535/1072] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:46 2022] GET /compute/v2.1/servers/aacf49fd-7b35-4e19-81f0-098fc9d2b0d6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:08:46.992448 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c48c52f1-69b5-4402-a1eb-3c88190f63d9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:46.992448 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c48c52f1-69b5-4402-a1eb-3c88190f63d9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:46.999390 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c48c52f1-69b5-4402-a1eb-3c88190f63d9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:47.000081 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c48c52f1-69b5-4402-a1eb-3c88190f63d9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:47.000699 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c48c52f1-69b5-4402-a1eb-3c88190f63d9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:47.001588 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c48c52f1-69b5-4402-a1eb-3c88190f63d9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:47.002395 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c48c52f1-69b5-4402-a1eb-3c88190f63d9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:47.002840 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c48c52f1-69b5-4402-a1eb-3c88190f63d9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:47.145599 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c48c52f1-69b5-4402-a1eb-3c88190f63d9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:47.154204 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c48c52f1-69b5-4402-a1eb-3c88190f63d9 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1453 microversion: 2.1 time: 0.168760 Sep 01 14:08:47.154864 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 538/1073] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:46 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:47.174953 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-6204459a-76aa-4b8d-8d6f-8ea872f0f68a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:47.175637 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-6204459a-76aa-4b8d-8d6f-8ea872f0f68a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:47.182194 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6204459a-76aa-4b8d-8d6f-8ea872f0f68a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:47.182753 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6204459a-76aa-4b8d-8d6f-8ea872f0f68a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:47.183192 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6204459a-76aa-4b8d-8d6f-8ea872f0f68a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:47.183911 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6204459a-76aa-4b8d-8d6f-8ea872f0f68a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:47.184371 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6204459a-76aa-4b8d-8d6f-8ea872f0f68a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:47.184824 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-6204459a-76aa-4b8d-8d6f-8ea872f0f68a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:47.326696 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-6204459a-76aa-4b8d-8d6f-8ea872f0f68a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:08:47.334517 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-6204459a-76aa-4b8d-8d6f-8ea872f0f68a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1453 microversion: 2.1 time: 0.163324 Sep 01 14:08:47.335142 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 536/1074] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:08:47 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:48.051656 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-74378889-0e67-4979-8777-5d1b898c5adf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:48.052174 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-74378889-0e67-4979-8777-5d1b898c5adf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:48.058807 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74378889-0e67-4979-8777-5d1b898c5adf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:48.059295 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74378889-0e67-4979-8777-5d1b898c5adf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:48.059738 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74378889-0e67-4979-8777-5d1b898c5adf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:48.060610 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74378889-0e67-4979-8777-5d1b898c5adf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:48.061076 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74378889-0e67-4979-8777-5d1b898c5adf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:48.061554 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-74378889-0e67-4979-8777-5d1b898c5adf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:48.075730 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-74378889-0e67-4979-8777-5d1b898c5adf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] HTTP exception thrown: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-74378889-0e67-4979-8777-5d1b898c5adf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Request method failure captured: Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: DELETE /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a HTTP/1.1 Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELsRog0CJcPYnwKv9f7xm92IKcNoh3D-IsG2eJ_g95XfMwbEzqe6qSgkUC49ZfLMbsozlxZr_m5SK4mQF02vH2pUSppg1b36GgCvg3sxnDTAol7C6owTWp71mXhbSMEs0yIFn0AoHHVgPfJ4CoxFI2ceHMBsZdCF53XnoWNesf4GIMQ Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 7e322f2f7da74039aff258b70af12095 Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:08:48.077315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:08:48.079003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7e322f2f7da74039aff258b70af12095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7e322f2f7da74039aff258b70af12095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7e322f2f7da74039aff258b70af12095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7e322f2f7da74039aff258b70af12095"}]}] Sep 01 14:08:48.079003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:48.079003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 7e322f2f7da74039aff258b70af12095 Sep 01 14:08:48.079003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:48.079003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-AttachVolumeShelveTestJSON-1921641283-project Sep 01 14:08:48.079003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:08:48.079003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:08:48.079003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: b77f38582b8842d7a303e8431299191a Sep 01 14:08:48.079003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1921641283-project Sep 01 14:08:48.079003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:08:48.079003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:08:48.079003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '0bac5a33-d73f-48a4-bead-fcf039becf3a'} Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:48.079895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:08:48.081556 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:08:48.083076 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-74378889-0e67-4979-8777-5d1b898c5adf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Returning 404 to user: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:48.083076 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-74378889-0e67-4979-8777-5d1b898c5adf tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 404 len: 111 microversion: 2.20 time: 0.031139 Sep 01 14:08:48.083076 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 539/1075] 10.222.0.61 () {60 vars in 1280 bytes} [Thu Sep 1 14:08:48 2022] DELETE /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:08:48.088952 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a96e1b85-0da2-4268-8257-6d58fb1328f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:48.089554 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a96e1b85-0da2-4268-8257-6d58fb1328f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] [instance: 0bac5a33-d73f-48a4-bead-fcf039becf3a] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:08:48.095847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a96e1b85-0da2-4268-8257-6d58fb1328f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:48.096378 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a96e1b85-0da2-4268-8257-6d58fb1328f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:48.096821 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a96e1b85-0da2-4268-8257-6d58fb1328f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:48.097527 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a96e1b85-0da2-4268-8257-6d58fb1328f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:48.098021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a96e1b85-0da2-4268-8257-6d58fb1328f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:48.098449 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a96e1b85-0da2-4268-8257-6d58fb1328f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:48.117126 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-a96e1b85-0da2-4268-8257-6d58fb1328f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] HTTP exception thrown: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a96e1b85-0da2-4268-8257-6d58fb1328f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Request method failure captured: Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a HTTP/1.1 Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELsRog0CJcPYnwKv9f7xm92IKcNoh3D-IsG2eJ_g95XfMwbEzqe6qSgkUC49ZfLMbsozlxZr_m5SK4mQF02vH2pUSppg1b36GgCvg3sxnDTAol7C6owTWp71mXhbSMEs0yIFn0AoHHVgPfJ4CoxFI2ceHMBsZdCF53XnoWNesf4GIMQ Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 7e322f2f7da74039aff258b70af12095 Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:08:48.118705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:08:48.123881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7e322f2f7da74039aff258b70af12095"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7e322f2f7da74039aff258b70af12095"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7e322f2f7da74039aff258b70af12095"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7e322f2f7da74039aff258b70af12095"}]}] Sep 01 14:08:48.123881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:48.123881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 7e322f2f7da74039aff258b70af12095 Sep 01 14:08:48.123881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1921641283 Sep 01 14:08:48.123881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-AttachVolumeShelveTestJSON-1921641283-project Sep 01 14:08:48.123881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:08:48.123881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:08:48.123881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: b77f38582b8842d7a303e8431299191a Sep 01 14:08:48.123881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1921641283-project Sep 01 14:08:48.123881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:08:48.123881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:08:48.123881 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '0bac5a33-d73f-48a4-bead-fcf039becf3a'} Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:08:48.124622 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. Sep 01 14:08:48.127991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:08:48.130038 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a96e1b85-0da2-4268-8257-6d58fb1328f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] Returning 404 to user: Instance 0bac5a33-d73f-48a4-bead-fcf039becf3a could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:08:48.130038 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a96e1b85-0da2-4268-8257-6d58fb1328f7 tempest-AttachVolumeShelveTestJSON-1921641283 tempest-AttachVolumeShelveTestJSON-1921641283-project] 10.222.0.61 "GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a" status: 404 len: 111 microversion: 2.20 time: 0.035701 Sep 01 14:08:48.130038 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 537/1076] 10.222.0.61 () {60 vars in 1277 bytes} [Thu Sep 1 14:08:48 2022] GET /compute/v2.1/servers/0bac5a33-d73f-48a4-bead-fcf039becf3a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 14:08:48.592164 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d9a08ce3-6456-4d0f-8cce-c513341e4d71 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] Calling method '.version_select at 0x7f1afd61fa60>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:48.886079 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d9a08ce3-6456-4d0f-8cce-c513341e4d71 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/3333014f-e585-4c22-b712-16303c5c2d63" status: 200 len: 351 microversion: 2.1 time: 0.297753 Sep 01 14:08:48.887845 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 540/1077] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:08:48 2022] GET /compute/v2.1/os-volumes/3333014f-e585-4c22-b712-16303c5c2d63 => generated 351 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:50.345637 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-e9ad9b98-c86d-4e53-a9c2-9cf0d3e8375b req-7172aaa4-1c54-4d38-bb2a-6db740c2fd9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7007a86d-dd1d-45fe-a163-9f3c5118e51b", "tag": "b3883027-3665-4906-802f-0c55de1ef651"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:08:50.363652 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-e9ad9b98-c86d-4e53-a9c2-9cf0d3e8375b req-7172aaa4-1c54-4d38-bb2a-6db740c2fd9f service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:08:50.364393 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-e9ad9b98-c86d-4e53-a9c2-9cf0d3e8375b req-7172aaa4-1c54-4d38-bb2a-6db740c2fd9f service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:08:50.364824 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-e9ad9b98-c86d-4e53-a9c2-9cf0d3e8375b req-7172aaa4-1c54-4d38-bb2a-6db740c2fd9f service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:08:50.399980 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-e9ad9b98-c86d-4e53-a9c2-9cf0d3e8375b req-7172aaa4-1c54-4d38-bb2a-6db740c2fd9f service nova] Creating event network-changed:b3883027-3665-4906-802f-0c55de1ef651 for instance 7007a86d-dd1d-45fe-a163-9f3c5118e51b on hv-cinder-85221 Sep 01 14:08:50.405824 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-e9ad9b98-c86d-4e53-a9c2-9cf0d3e8375b req-7172aaa4-1c54-4d38-bb2a-6db740c2fd9f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062636 Sep 01 14:08:50.408065 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 538/1078] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:51.307269 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8e0d155e-8e3f-4246-a123-85888faca066 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] Calling method '.version_select at 0x7f1afd6b0940>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:51.374703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8e0d155e-8e3f-4246-a123-85888faca066 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/93b8c89f-7a3a-4a9d-9b49-b06558a2cee9" status: 200 len: 350 microversion: 2.1 time: 0.071280 Sep 01 14:08:51.376674 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 541/1079] 10.222.0.61 () {58 vars in 1245 bytes} [Thu Sep 1 14:08:51 2022] GET /compute/v2.1/os-volumes/93b8c89f-7a3a-4a9d-9b49-b06558a2cee9 => generated 350 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:51.396064 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-041b3638-c905-49ef-9803-2a92dc7d3332 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] Calling method '.version_select at 0x7f1afd4569d0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:51.501737 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-041b3638-c905-49ef-9803-2a92dc7d3332 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.113684 Sep 01 14:08:51.503148 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 539/1080] 10.222.0.61 () {58 vars in 1134 bytes} [Thu Sep 1 14:08:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:51.517546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6560700c-8659-4202-a903-5ba8a73070e7 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] Calling method '.version_select at 0x7f1afd59cee0>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:51.620427 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6560700c-8659-4202-a903-5ba8a73070e7 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.106682 Sep 01 14:08:51.621001 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 542/1081] 10.222.0.61 () {58 vars in 1149 bytes} [Thu Sep 1 14:08:51 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:51.634927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4529bd58-b7ae-4a02-a72c-dfc092da3676 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] Calling method '.version_select at 0x7f1afd37f0d0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:51.868257 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4529bd58-b7ae-4a02-a72c-dfc092da3676 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.237700 Sep 01 14:08:51.868830 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 540/1082] 10.222.0.61 () {58 vars in 1134 bytes} [Thu Sep 1 14:08:51 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:51.882009 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f46e3cda-6178-40cf-80c4-c00d661f6d49 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] Calling method '.version_select at 0x7f1afd56f040>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:51.976413 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f46e3cda-6178-40cf-80c4-c00d661f6d49 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.098129 Sep 01 14:08:51.976994 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 543/1083] 10.222.0.61 () {58 vars in 1167 bytes} [Thu Sep 1 14:08:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:51.990562 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a9dc6a88-1daa-4d28-aeb8-ac70641029b9 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] Calling method '.version_select at 0x7f1b00c42e50>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:52.074719 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a9dc6a88-1daa-4d28-aeb8-ac70641029b9 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087827 Sep 01 14:08:52.075286 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 541/1084] 10.222.0.61 () {58 vars in 1170 bytes} [Thu Sep 1 14:08:51 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:52.095680 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-0648ed30-1782-4f9a-a6a7-dbd8613e2b31 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] Calling method '.version_select at 0x7f1afd61f0d0>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:52.180010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-0648ed30-1782-4f9a-a6a7-dbd8613e2b31 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088122 Sep 01 14:08:52.180623 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 544/1085] 10.222.0.61 () {58 vars in 1155 bytes} [Thu Sep 1 14:08:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:08:52.193628 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-b4b305eb-3d38-4a22-ad48-8d919dbb5522 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] Calling method '.version_select at 0x7f1afd456310>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:52.280012 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-b4b305eb-3d38-4a22-ad48-8d919dbb5522 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090012 Sep 01 14:08:52.288843 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 542/1086] 10.222.0.61 () {58 vars in 1188 bytes} [Thu Sep 1 14:08:52 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:08:52.294403 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f8baf931-5a2b-4246-9876-f4ebc0680ab8 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] Calling method '.version_select at 0x7f1afd59cf70>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:08:52.393115 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f8baf931-5a2b-4246-9876-f4ebc0680ab8 tempest-VolumesTestJSON-459736777 tempest-VolumesTestJSON-459736777-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.102487 Sep 01 14:08:52.393737 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 545/1087] 10.222.0.61 () {58 vars in 1155 bytes} [Thu Sep 1 14:08:52 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:13.072041 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:13.073093 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=54 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:13.078901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-92476594", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "networks": [{"uuid": "e8cf0167-96de-4152-af09-621779051232"}]}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:13.136306 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.network.neutron [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] validate_networks() for [('e8cf0167-96de-4152-af09-621779051232', None, None, None, None, None)] {{(pid=127811) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:09:13.511434 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Flavor limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:09:13.529101 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Image limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:09:13.529101 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Flavor pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:09:13.529101 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Image pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:09:13.529101 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:09:13.529101 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:13.530270 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:13.530270 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:13.530270 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:13.530270 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:13.530636 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:13.545819 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Getting quotas for project 035b87bdd94646d0aed7727e587ab40f. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:09:13.550179 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Getting quotas for user 35383b224a5a46de87c41b49fe1bd037 and project 035b87bdd94646d0aed7727e587ab40f. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:09:13.569074 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Going to run 1 instances... {{(pid=127811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:09:13.571633 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:09:13.955853 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [efe3317b-8a39-4830-b448-9551e7a65ce1] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 14:09:14.964928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO oslo.messaging._drivers.impl_rabbit [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [efe3317b-8a39-4830-b448-9551e7a65ce1] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 35408. Sep 01 14:09:14.971502 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1e43188b-1f83-4e31-8b5f-e2216412644d tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.900743 Sep 01 14:09:14.972739 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 543/1088] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:09:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:09:14.988072 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:14.998632 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=78 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:15.006367 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f39f2ff1-759d-4085-887d-ca70d09f542f tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:15.007428 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f39f2ff1-759d-4085-887d-ca70d09f542f tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:15.102659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f39f2ff1-759d-4085-887d-ca70d09f542f tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:15.110536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f39f2ff1-759d-4085-887d-ca70d09f542f tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1217 microversion: 2.1 time: 0.125397 Sep 01 14:09:15.111276 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 546/1089] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:14 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1217 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:16.133602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2ee66a7c-299c-4445-8b38-ed8619d3b8ac tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:16.134268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2ee66a7c-299c-4445-8b38-ed8619d3b8ac tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:16.211435 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2ee66a7c-299c-4445-8b38-ed8619d3b8ac tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:16.220255 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2ee66a7c-299c-4445-8b38-ed8619d3b8ac tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1217 microversion: 2.1 time: 0.091816 Sep 01 14:09:16.221841 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 544/1090] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:16 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:17.250224 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ece778c9-6963-4b3f-bdfa-2df391dbe3db tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:17.251006 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ece778c9-6963-4b3f-bdfa-2df391dbe3db tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:17.260435 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ece778c9-6963-4b3f-bdfa-2df391dbe3db tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:17.260931 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ece778c9-6963-4b3f-bdfa-2df391dbe3db tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:17.261416 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ece778c9-6963-4b3f-bdfa-2df391dbe3db tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:17.262121 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ece778c9-6963-4b3f-bdfa-2df391dbe3db tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:17.262581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ece778c9-6963-4b3f-bdfa-2df391dbe3db tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:17.263010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ece778c9-6963-4b3f-bdfa-2df391dbe3db tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:17.328574 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ece778c9-6963-4b3f-bdfa-2df391dbe3db tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:17.337304 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ece778c9-6963-4b3f-bdfa-2df391dbe3db tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1221 microversion: 2.1 time: 0.094044 Sep 01 14:09:17.337897 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 547/1091] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:17 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:18.357265 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-41e9854e-10d1-45a4-b2bf-03e367f71afd tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:18.358132 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-41e9854e-10d1-45a4-b2bf-03e367f71afd tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:18.364865 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41e9854e-10d1-45a4-b2bf-03e367f71afd tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:18.366329 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41e9854e-10d1-45a4-b2bf-03e367f71afd tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:18.366784 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41e9854e-10d1-45a4-b2bf-03e367f71afd tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:18.367911 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41e9854e-10d1-45a4-b2bf-03e367f71afd tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:18.368427 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41e9854e-10d1-45a4-b2bf-03e367f71afd tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:18.369014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-41e9854e-10d1-45a4-b2bf-03e367f71afd tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:18.449615 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-41e9854e-10d1-45a4-b2bf-03e367f71afd tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:18.457474 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-41e9854e-10d1-45a4-b2bf-03e367f71afd tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1269 microversion: 2.1 time: 0.104523 Sep 01 14:09:18.458223 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 545/1092] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:18 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1269 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:19.484971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-348c91cf-f301-4f0b-93bb-d460de4893d1 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:19.486460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-348c91cf-f301-4f0b-93bb-d460de4893d1 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:19.494869 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-348c91cf-f301-4f0b-93bb-d460de4893d1 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:19.495477 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-348c91cf-f301-4f0b-93bb-d460de4893d1 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:19.496183 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-348c91cf-f301-4f0b-93bb-d460de4893d1 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:19.496993 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-348c91cf-f301-4f0b-93bb-d460de4893d1 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:19.497545 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-348c91cf-f301-4f0b-93bb-d460de4893d1 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:19.498244 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-348c91cf-f301-4f0b-93bb-d460de4893d1 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:19.583109 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-348c91cf-f301-4f0b-93bb-d460de4893d1 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:19.605945 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-348c91cf-f301-4f0b-93bb-d460de4893d1 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1275 microversion: 2.1 time: 0.125215 Sep 01 14:09:19.607070 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 548/1093] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:19 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1275 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:20.628143 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d5074331-af7c-41b8-a310-e221b9ad8a48 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:20.628785 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d5074331-af7c-41b8-a310-e221b9ad8a48 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:20.635819 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5074331-af7c-41b8-a310-e221b9ad8a48 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:20.636311 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5074331-af7c-41b8-a310-e221b9ad8a48 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:20.641021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5074331-af7c-41b8-a310-e221b9ad8a48 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:20.641021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5074331-af7c-41b8-a310-e221b9ad8a48 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:20.641021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5074331-af7c-41b8-a310-e221b9ad8a48 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:20.641021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d5074331-af7c-41b8-a310-e221b9ad8a48 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:20.898818 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d5074331-af7c-41b8-a310-e221b9ad8a48 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:20.906781 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d5074331-af7c-41b8-a310-e221b9ad8a48 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1317 microversion: 2.1 time: 0.282998 Sep 01 14:09:20.907354 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 546/1094] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:20 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:21.059300 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-ddfc2ffd-da9f-4614-99a2-3f9716f842b5 req-3cfe529c-e312-4620-a6d1-3cbfccca1fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c438dca-5d0e-40bc-b802-75ff523b6402", "tag": "7d5c2c45-c592-465c-92ec-293116f96fea"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:21.069293 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ddfc2ffd-da9f-4614-99a2-3f9716f842b5 req-3cfe529c-e312-4620-a6d1-3cbfccca1fc8 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:21.069802 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ddfc2ffd-da9f-4614-99a2-3f9716f842b5 req-3cfe529c-e312-4620-a6d1-3cbfccca1fc8 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:21.070235 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-ddfc2ffd-da9f-4614-99a2-3f9716f842b5 req-3cfe529c-e312-4620-a6d1-3cbfccca1fc8 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:21.083703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-ddfc2ffd-da9f-4614-99a2-3f9716f842b5 req-3cfe529c-e312-4620-a6d1-3cbfccca1fc8 service nova] Creating event network-changed:7d5c2c45-c592-465c-92ec-293116f96fea for instance 1c438dca-5d0e-40bc-b802-75ff523b6402 on hv-cinder-85221 Sep 01 14:09:21.089256 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-ddfc2ffd-da9f-4614-99a2-3f9716f842b5 req-3cfe529c-e312-4620-a6d1-3cbfccca1fc8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034525 Sep 01 14:09:21.092425 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 549/1095] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:21.929113 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-202a15c5-f9ec-448e-b2e8-f77c45069dc0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:21.930319 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-202a15c5-f9ec-448e-b2e8-f77c45069dc0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:21.937810 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-202a15c5-f9ec-448e-b2e8-f77c45069dc0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:21.938313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-202a15c5-f9ec-448e-b2e8-f77c45069dc0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:21.938780 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-202a15c5-f9ec-448e-b2e8-f77c45069dc0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:21.939501 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-202a15c5-f9ec-448e-b2e8-f77c45069dc0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:21.940083 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-202a15c5-f9ec-448e-b2e8-f77c45069dc0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:21.940509 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-202a15c5-f9ec-448e-b2e8-f77c45069dc0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:22.076926 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-202a15c5-f9ec-448e-b2e8-f77c45069dc0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:22.085309 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-202a15c5-f9ec-448e-b2e8-f77c45069dc0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1317 microversion: 2.1 time: 0.161263 Sep 01 14:09:22.085934 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 547/1096] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:21 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:23.106644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d9dd304c-9393-4f43-a3b9-3ed4faea8dff tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:23.107341 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d9dd304c-9393-4f43-a3b9-3ed4faea8dff tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:23.113926 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d9dd304c-9393-4f43-a3b9-3ed4faea8dff tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:23.118192 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d9dd304c-9393-4f43-a3b9-3ed4faea8dff tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:23.118192 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d9dd304c-9393-4f43-a3b9-3ed4faea8dff tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:23.118192 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d9dd304c-9393-4f43-a3b9-3ed4faea8dff tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:23.118192 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d9dd304c-9393-4f43-a3b9-3ed4faea8dff tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:23.118614 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d9dd304c-9393-4f43-a3b9-3ed4faea8dff tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:23.256208 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d9dd304c-9393-4f43-a3b9-3ed4faea8dff tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:23.263976 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d9dd304c-9393-4f43-a3b9-3ed4faea8dff tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1317 microversion: 2.1 time: 0.161442 Sep 01 14:09:23.264545 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 550/1097] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:23 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:24.284715 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5a18aa4e-f09c-4511-a645-302c7cced983 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:24.285338 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-5a18aa4e-f09c-4511-a645-302c7cced983 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:24.288445 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:24.294838 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5a18aa4e-f09c-4511-a645-302c7cced983 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:24.295336 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5a18aa4e-f09c-4511-a645-302c7cced983 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:24.295960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5a18aa4e-f09c-4511-a645-302c7cced983 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:24.296672 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5a18aa4e-f09c-4511-a645-302c7cced983 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:24.297128 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5a18aa4e-f09c-4511-a645-302c7cced983 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:24.297554 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5a18aa4e-f09c-4511-a645-302c7cced983 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:24.440786 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5a18aa4e-f09c-4511-a645-302c7cced983 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:24.447602 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-5a18aa4e-f09c-4511-a645-302c7cced983 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1317 microversion: 2.1 time: 0.166806 Sep 01 14:09:24.448187 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 548/1098] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:24 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:25.468554 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-42d88f1b-c0eb-4dd5-8137-47d15ab5d1c9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:25.469161 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-42d88f1b-c0eb-4dd5-8137-47d15ab5d1c9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:25.473003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:25.477323 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-42d88f1b-c0eb-4dd5-8137-47d15ab5d1c9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:25.477834 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-42d88f1b-c0eb-4dd5-8137-47d15ab5d1c9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:25.478272 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-42d88f1b-c0eb-4dd5-8137-47d15ab5d1c9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:25.478975 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-42d88f1b-c0eb-4dd5-8137-47d15ab5d1c9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:25.479425 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-42d88f1b-c0eb-4dd5-8137-47d15ab5d1c9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:25.479845 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-42d88f1b-c0eb-4dd5-8137-47d15ab5d1c9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:25.620121 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-42d88f1b-c0eb-4dd5-8137-47d15ab5d1c9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:25.628448 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-42d88f1b-c0eb-4dd5-8137-47d15ab5d1c9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1317 microversion: 2.1 time: 0.163874 Sep 01 14:09:25.629438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 551/1099] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:25 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:26.649814 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-daa18747-d21d-41e1-91fe-5e4c509a684a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:26.650433 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-daa18747-d21d-41e1-91fe-5e4c509a684a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:26.652807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=8 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:26.657674 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-daa18747-d21d-41e1-91fe-5e4c509a684a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:26.658195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-daa18747-d21d-41e1-91fe-5e4c509a684a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:26.658631 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-daa18747-d21d-41e1-91fe-5e4c509a684a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:26.659332 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-daa18747-d21d-41e1-91fe-5e4c509a684a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:26.659783 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-daa18747-d21d-41e1-91fe-5e4c509a684a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:26.660207 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-daa18747-d21d-41e1-91fe-5e4c509a684a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:26.790871 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-daa18747-d21d-41e1-91fe-5e4c509a684a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:26.798792 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-daa18747-d21d-41e1-91fe-5e4c509a684a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1317 microversion: 2.1 time: 0.153288 Sep 01 14:09:26.799361 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 549/1100] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:26 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:27.820273 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ff193865-423d-4462-97cb-5f68c5c9b3eb tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:27.820875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ff193865-423d-4462-97cb-5f68c5c9b3eb tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:27.827681 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ff193865-423d-4462-97cb-5f68c5c9b3eb tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:27.828171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ff193865-423d-4462-97cb-5f68c5c9b3eb tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:27.828612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ff193865-423d-4462-97cb-5f68c5c9b3eb tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:27.829317 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ff193865-423d-4462-97cb-5f68c5c9b3eb tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:27.829828 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ff193865-423d-4462-97cb-5f68c5c9b3eb tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:27.830323 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ff193865-423d-4462-97cb-5f68c5c9b3eb tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:27.968602 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ff193865-423d-4462-97cb-5f68c5c9b3eb tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:27.977037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ff193865-423d-4462-97cb-5f68c5c9b3eb tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1317 microversion: 2.1 time: 0.160831 Sep 01 14:09:27.977619 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 552/1101] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:27 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:09:28.595924 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-a54057a2-6878-4bbc-b90c-aad096b2a3a6 req-bed1d060-7ccf-4406-a5c2-701a5c6e462f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c438dca-5d0e-40bc-b802-75ff523b6402", "name": "network-vif-plugged", "status": "completed", "tag": "7d5c2c45-c592-465c-92ec-293116f96fea"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:28.607231 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-a54057a2-6878-4bbc-b90c-aad096b2a3a6 req-bed1d060-7ccf-4406-a5c2-701a5c6e462f service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:28.607509 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-a54057a2-6878-4bbc-b90c-aad096b2a3a6 req-bed1d060-7ccf-4406-a5c2-701a5c6e462f service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:28.607949 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-a54057a2-6878-4bbc-b90c-aad096b2a3a6 req-bed1d060-7ccf-4406-a5c2-701a5c6e462f service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:28.618844 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-a54057a2-6878-4bbc-b90c-aad096b2a3a6 req-bed1d060-7ccf-4406-a5c2-701a5c6e462f service nova] Creating event network-vif-plugged:7d5c2c45-c592-465c-92ec-293116f96fea for instance 1c438dca-5d0e-40bc-b802-75ff523b6402 on hv-cinder-85221 Sep 01 14:09:28.623966 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-a54057a2-6878-4bbc-b90c-aad096b2a3a6 req-bed1d060-7ccf-4406-a5c2-701a5c6e462f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031841 Sep 01 14:09:28.624713 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 550/1102] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:28.999587 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-80511a03-34b9-426f-b08a-827dd2cb1ca3 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:29.000180 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-80511a03-34b9-426f-b08a-827dd2cb1ca3 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:29.007041 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-80511a03-34b9-426f-b08a-827dd2cb1ca3 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:29.007524 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-80511a03-34b9-426f-b08a-827dd2cb1ca3 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:29.007967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-80511a03-34b9-426f-b08a-827dd2cb1ca3 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:29.008674 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-80511a03-34b9-426f-b08a-827dd2cb1ca3 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:29.009119 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-80511a03-34b9-426f-b08a-827dd2cb1ca3 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:29.009542 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-80511a03-34b9-426f-b08a-827dd2cb1ca3 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:29.206465 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-80511a03-34b9-426f-b08a-827dd2cb1ca3 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:29.214853 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-80511a03-34b9-426f-b08a-827dd2cb1ca3 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1317 microversion: 2.1 time: 0.219537 Sep 01 14:09:29.215437 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 553/1103] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:28 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:30.237205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c4ba5500-3575-4723-a099-7515626da6e0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:30.237932 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c4ba5500-3575-4723-a099-7515626da6e0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:30.245136 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c4ba5500-3575-4723-a099-7515626da6e0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:30.245628 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c4ba5500-3575-4723-a099-7515626da6e0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:30.246089 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c4ba5500-3575-4723-a099-7515626da6e0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:30.246815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c4ba5500-3575-4723-a099-7515626da6e0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:30.247285 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c4ba5500-3575-4723-a099-7515626da6e0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:30.247711 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c4ba5500-3575-4723-a099-7515626da6e0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:30.398257 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c4ba5500-3575-4723-a099-7515626da6e0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:30.406634 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c4ba5500-3575-4723-a099-7515626da6e0 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1317 microversion: 2.1 time: 0.173876 Sep 01 14:09:30.407258 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 551/1104] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:30 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:31.428834 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-efb11c29-0395-4e10-acb7-df61f4ec996c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:31.429393 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-efb11c29-0395-4e10-acb7-df61f4ec996c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:31.436073 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb11c29-0395-4e10-acb7-df61f4ec996c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:31.436615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb11c29-0395-4e10-acb7-df61f4ec996c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:31.437037 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb11c29-0395-4e10-acb7-df61f4ec996c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:31.437750 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb11c29-0395-4e10-acb7-df61f4ec996c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:31.438234 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb11c29-0395-4e10-acb7-df61f4ec996c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:31.438664 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-efb11c29-0395-4e10-acb7-df61f4ec996c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:31.580742 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-efb11c29-0395-4e10-acb7-df61f4ec996c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:31.583330 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-efb11c29-0395-4e10-acb7-df61f4ec996c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1505 microversion: 2.1 time: 0.158643 Sep 01 14:09:31.584392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 554/1105] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:31 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:09:50.788712 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-71b6518a-c972-4252-a876-4a11949c67e5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f68708c7-277c-4e3b-a216-72c70527b31f", "device": "/dev/sdb"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:50.791804 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-71b6518a-c972-4252-a876-4a11949c67e5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:50.794351 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:50.794983 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=40 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:50.799703 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-71b6518a-c972-4252-a876-4a11949c67e5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:50.806180 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-71b6518a-c972-4252-a876-4a11949c67e5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:50.806180 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-71b6518a-c972-4252-a876-4a11949c67e5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:50.806180 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-71b6518a-c972-4252-a876-4a11949c67e5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:50.806180 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-71b6518a-c972-4252-a876-4a11949c67e5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:50.806556 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-71b6518a-c972-4252-a876-4a11949c67e5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:52.203032 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-71b6518a-c972-4252-a876-4a11949c67e5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "POST /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.418615 Sep 01 14:09:52.203741 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 552/1106] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:09:50 2022] POST /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402/os-volume_attachments => generated 194 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:09:58.602303 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-445341285", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452"}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:09:58.609696 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=20 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:58.610392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=44 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:09:58.656252 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.network.neutron [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] validate_networks() for None {{(pid=127812) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:09:58.939720 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Flavor limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:09:58.940483 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Image limits 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:09:58.940641 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Flavor pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:09:58.941183 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Image pref 0:0:0 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:09:58.941605 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.virt.hardware [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127812) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:09:58.951422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:58.951911 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:58.952351 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:58.953109 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:09:58.953563 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:09:58.954019 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:09:58.972285 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Getting quotas for project 442a8080466045d1ac6d252642b56208. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:09:58.977950 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Getting quotas for user 1d333e453a8d4df8a1f58d6ffe30fce7 and project 442a8080466045d1ac6d252642b56208. Resources: {'cores', 'instances', 'ram'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:09:58.987764 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Going to run 1 instances... {{(pid=127812) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:09:58.990052 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127812) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:09:59.246751 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-26ecb489-b8d5-4776-8f37-47595837ce7c tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.648447 Sep 01 14:09:59.247366 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 555/1107] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:09:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:09:59.259379 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f0f2c223-8ccf-4655-8df6-4859ea0fb461 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:09:59.264380 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f0f2c223-8ccf-4655-8df6-4859ea0fb461 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:09:59.318480 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f0f2c223-8ccf-4655-8df6-4859ea0fb461 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:09:59.326063 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f0f2c223-8ccf-4655-8df6-4859ea0fb461 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1214 microversion: 2.1 time: 0.071382 Sep 01 14:09:59.326639 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 553/1108] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:09:59 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:00.347734 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3fa8dbd4-b870-4877-9348-27f1da90fb90 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:00.348377 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3fa8dbd4-b870-4877-9348-27f1da90fb90 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:00.404404 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3fa8dbd4-b870-4877-9348-27f1da90fb90 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:00.408436 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3fa8dbd4-b870-4877-9348-27f1da90fb90 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1214 microversion: 2.1 time: 0.064717 Sep 01 14:10:00.409004 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 556/1109] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:00 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:01.428851 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a52d4e98-71e5-460b-808b-c00083119e9a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:01.429466 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a52d4e98-71e5-460b-808b-c00083119e9a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:01.437292 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a52d4e98-71e5-460b-808b-c00083119e9a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:01.437866 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a52d4e98-71e5-460b-808b-c00083119e9a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:01.443283 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a52d4e98-71e5-460b-808b-c00083119e9a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:01.443283 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a52d4e98-71e5-460b-808b-c00083119e9a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:01.443283 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a52d4e98-71e5-460b-808b-c00083119e9a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:01.443283 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a52d4e98-71e5-460b-808b-c00083119e9a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:01.502200 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a52d4e98-71e5-460b-808b-c00083119e9a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:01.510888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a52d4e98-71e5-460b-808b-c00083119e9a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1218 microversion: 2.1 time: 0.086186 Sep 01 14:10:01.511456 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 554/1110] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:01 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:02.532560 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d3c6261c-aa50-4470-8b7b-5119aaf1739f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:02.533216 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d3c6261c-aa50-4470-8b7b-5119aaf1739f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:02.541013 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d3c6261c-aa50-4470-8b7b-5119aaf1739f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:02.541498 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d3c6261c-aa50-4470-8b7b-5119aaf1739f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:02.542187 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d3c6261c-aa50-4470-8b7b-5119aaf1739f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:02.543060 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d3c6261c-aa50-4470-8b7b-5119aaf1739f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:02.543510 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d3c6261c-aa50-4470-8b7b-5119aaf1739f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:02.543932 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d3c6261c-aa50-4470-8b7b-5119aaf1739f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:02.608274 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d3c6261c-aa50-4470-8b7b-5119aaf1739f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:02.616150 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d3c6261c-aa50-4470-8b7b-5119aaf1739f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1266 microversion: 2.1 time: 0.087699 Sep 01 14:10:02.616714 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 557/1111] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:02 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:03.638231 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e34e19c7-a122-487a-9e34-4f612500ef56 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:03.638859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e34e19c7-a122-487a-9e34-4f612500ef56 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:03.647146 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e34e19c7-a122-487a-9e34-4f612500ef56 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:03.651376 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e34e19c7-a122-487a-9e34-4f612500ef56 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:03.651376 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e34e19c7-a122-487a-9e34-4f612500ef56 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:03.651376 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e34e19c7-a122-487a-9e34-4f612500ef56 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:03.651376 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e34e19c7-a122-487a-9e34-4f612500ef56 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:03.651787 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e34e19c7-a122-487a-9e34-4f612500ef56 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:03.712999 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e34e19c7-a122-487a-9e34-4f612500ef56 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:03.720536 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e34e19c7-a122-487a-9e34-4f612500ef56 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1274 microversion: 2.1 time: 0.087168 Sep 01 14:10:03.721086 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 555/1112] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:03 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1274 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:04.741629 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-bf859c64-bdc2-4d13-a783-624528b798d7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:04.742279 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-bf859c64-bdc2-4d13-a783-624528b798d7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:04.749023 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf859c64-bdc2-4d13-a783-624528b798d7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:04.749507 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf859c64-bdc2-4d13-a783-624528b798d7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:04.749978 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf859c64-bdc2-4d13-a783-624528b798d7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:04.750685 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf859c64-bdc2-4d13-a783-624528b798d7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:04.751143 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf859c64-bdc2-4d13-a783-624528b798d7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:04.751575 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bf859c64-bdc2-4d13-a783-624528b798d7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:04.813618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-bf859c64-bdc2-4d13-a783-624528b798d7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:04.821958 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-bf859c64-bdc2-4d13-a783-624528b798d7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1274 microversion: 2.1 time: 0.084668 Sep 01 14:10:04.822534 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 558/1113] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:04 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:05.844076 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-551df344-e635-4230-8221-76951612f169 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:05.844962 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-551df344-e635-4230-8221-76951612f169 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:05.851526 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-551df344-e635-4230-8221-76951612f169 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:05.852279 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-551df344-e635-4230-8221-76951612f169 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:05.852774 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-551df344-e635-4230-8221-76951612f169 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:05.853491 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-551df344-e635-4230-8221-76951612f169 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:05.853981 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-551df344-e635-4230-8221-76951612f169 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:05.854443 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-551df344-e635-4230-8221-76951612f169 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:05.925488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-551df344-e635-4230-8221-76951612f169 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:05.933430 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-551df344-e635-4230-8221-76951612f169 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1284 microversion: 2.1 time: 0.093802 Sep 01 14:10:05.934031 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 556/1114] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:05 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:06.963447 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5d8a9355-f43b-4167-a819-3db3f2c06893 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:06.964048 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5d8a9355-f43b-4167-a819-3db3f2c06893 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:06.970141 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5d8a9355-f43b-4167-a819-3db3f2c06893 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:06.975778 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5d8a9355-f43b-4167-a819-3db3f2c06893 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:06.975778 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5d8a9355-f43b-4167-a819-3db3f2c06893 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:06.975778 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5d8a9355-f43b-4167-a819-3db3f2c06893 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:06.975778 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5d8a9355-f43b-4167-a819-3db3f2c06893 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:06.976171 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5d8a9355-f43b-4167-a819-3db3f2c06893 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:07.110853 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5d8a9355-f43b-4167-a819-3db3f2c06893 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:07.118549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5d8a9355-f43b-4167-a819-3db3f2c06893 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.158858 Sep 01 14:10:07.119086 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 559/1115] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:06 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:08.145702 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a4cea2ec-fe4e-4e5a-ab43-ff929bd8f1c3 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:08.148581 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a4cea2ec-fe4e-4e5a-ab43-ff929bd8f1c3 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:08.152934 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a4cea2ec-fe4e-4e5a-ab43-ff929bd8f1c3 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:08.153498 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a4cea2ec-fe4e-4e5a-ab43-ff929bd8f1c3 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:08.153999 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a4cea2ec-fe4e-4e5a-ab43-ff929bd8f1c3 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:08.154705 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a4cea2ec-fe4e-4e5a-ab43-ff929bd8f1c3 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:08.155160 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a4cea2ec-fe4e-4e5a-ab43-ff929bd8f1c3 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:08.155596 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a4cea2ec-fe4e-4e5a-ab43-ff929bd8f1c3 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:08.286034 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a4cea2ec-fe4e-4e5a-ab43-ff929bd8f1c3 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:08.294890 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a4cea2ec-fe4e-4e5a-ab43-ff929bd8f1c3 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.152977 Sep 01 14:10:08.295568 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 557/1116] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:08 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:09.317254 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-ac3487b9-4878-4988-9c7f-033f7f0520ce tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:09.317915 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-ac3487b9-4878-4988-9c7f-033f7f0520ce tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:09.320210 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:09.324980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ac3487b9-4878-4988-9c7f-033f7f0520ce tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:09.325461 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ac3487b9-4878-4988-9c7f-033f7f0520ce tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:09.325963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ac3487b9-4878-4988-9c7f-033f7f0520ce tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:09.326653 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ac3487b9-4878-4988-9c7f-033f7f0520ce tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:09.327102 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ac3487b9-4878-4988-9c7f-033f7f0520ce tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:09.327525 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-ac3487b9-4878-4988-9c7f-033f7f0520ce tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:09.457953 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-ac3487b9-4878-4988-9c7f-033f7f0520ce tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:09.466153 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-ac3487b9-4878-4988-9c7f-033f7f0520ce tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.153293 Sep 01 14:10:09.466992 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 560/1117] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:09 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:09.486366 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-466b9718-fb09-4e5c-9fbe-411a76e5fdaf req-c7deeee3-25e3-4066-9a37-526ae5df7f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f710322-34af-40ae-a950-149eb3bb046f", "tag": "68110cb3-0eb0-4eb4-8f49-ca2a724cfc7a"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:09.493865 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:09.497836 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-466b9718-fb09-4e5c-9fbe-411a76e5fdaf req-c7deeee3-25e3-4066-9a37-526ae5df7f90 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:09.498568 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-466b9718-fb09-4e5c-9fbe-411a76e5fdaf req-c7deeee3-25e3-4066-9a37-526ae5df7f90 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:09.498742 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-466b9718-fb09-4e5c-9fbe-411a76e5fdaf req-c7deeee3-25e3-4066-9a37-526ae5df7f90 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:09.510661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-466b9718-fb09-4e5c-9fbe-411a76e5fdaf req-c7deeee3-25e3-4066-9a37-526ae5df7f90 service nova] Creating event network-changed:68110cb3-0eb0-4eb4-8f49-ca2a724cfc7a for instance 2f710322-34af-40ae-a950-149eb3bb046f on hv-cinder-85221 Sep 01 14:10:09.515719 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-466b9718-fb09-4e5c-9fbe-411a76e5fdaf req-c7deeee3-25e3-4066-9a37-526ae5df7f90 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039306 Sep 01 14:10:09.516694 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 558/1118] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:10.487114 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6344f561-a80c-436e-8019-1eb2f94a6052 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:10.487757 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-6344f561-a80c-436e-8019-1eb2f94a6052 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:10.491032 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=8 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:10.495959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6344f561-a80c-436e-8019-1eb2f94a6052 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:10.496441 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6344f561-a80c-436e-8019-1eb2f94a6052 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:10.496875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6344f561-a80c-436e-8019-1eb2f94a6052 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:10.497566 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6344f561-a80c-436e-8019-1eb2f94a6052 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:10.498042 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6344f561-a80c-436e-8019-1eb2f94a6052 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:10.498463 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6344f561-a80c-436e-8019-1eb2f94a6052 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:10.630061 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-6344f561-a80c-436e-8019-1eb2f94a6052 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:10.637729 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6344f561-a80c-436e-8019-1eb2f94a6052 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.154490 Sep 01 14:10:10.638312 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 561/1119] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:10 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:11.659719 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-04693acc-ed39-4179-8c28-2b15d235a28a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:11.660418 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-04693acc-ed39-4179-8c28-2b15d235a28a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:11.667822 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-04693acc-ed39-4179-8c28-2b15d235a28a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:11.668310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-04693acc-ed39-4179-8c28-2b15d235a28a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:11.668753 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-04693acc-ed39-4179-8c28-2b15d235a28a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:11.669485 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-04693acc-ed39-4179-8c28-2b15d235a28a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:11.669984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-04693acc-ed39-4179-8c28-2b15d235a28a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:11.670448 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-04693acc-ed39-4179-8c28-2b15d235a28a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:11.810446 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-04693acc-ed39-4179-8c28-2b15d235a28a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:11.820006 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-04693acc-ed39-4179-8c28-2b15d235a28a tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.164550 Sep 01 14:10:11.820667 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 559/1120] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:11 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:12.841820 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-085541ce-b848-4c2f-bffe-2d6fc9bfd0e0 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:12.842495 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-085541ce-b848-4c2f-bffe-2d6fc9bfd0e0 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:12.850220 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-085541ce-b848-4c2f-bffe-2d6fc9bfd0e0 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:12.850711 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-085541ce-b848-4c2f-bffe-2d6fc9bfd0e0 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:12.851154 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-085541ce-b848-4c2f-bffe-2d6fc9bfd0e0 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:12.851861 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-085541ce-b848-4c2f-bffe-2d6fc9bfd0e0 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:12.852353 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-085541ce-b848-4c2f-bffe-2d6fc9bfd0e0 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:12.852788 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-085541ce-b848-4c2f-bffe-2d6fc9bfd0e0 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:12.987069 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-085541ce-b848-4c2f-bffe-2d6fc9bfd0e0 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:12.995911 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-085541ce-b848-4c2f-bffe-2d6fc9bfd0e0 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.157932 Sep 01 14:10:12.996615 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 562/1121] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:12 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:14.018702 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a17a1f09-203a-46a7-851a-2dd7c72aa6eb tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:14.019521 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a17a1f09-203a-46a7-851a-2dd7c72aa6eb tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:14.026301 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a17a1f09-203a-46a7-851a-2dd7c72aa6eb tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:14.026793 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a17a1f09-203a-46a7-851a-2dd7c72aa6eb tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:14.027298 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a17a1f09-203a-46a7-851a-2dd7c72aa6eb tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:14.028001 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a17a1f09-203a-46a7-851a-2dd7c72aa6eb tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:14.028496 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a17a1f09-203a-46a7-851a-2dd7c72aa6eb tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:14.028927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a17a1f09-203a-46a7-851a-2dd7c72aa6eb tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:14.171000 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a17a1f09-203a-46a7-851a-2dd7c72aa6eb tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:14.179849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a17a1f09-203a-46a7-851a-2dd7c72aa6eb tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.165288 Sep 01 14:10:14.180688 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 560/1122] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:14 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:15.200546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1c0ee110-f48e-4e9e-bf3a-9f6aaa20c0f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:15.201149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1c0ee110-f48e-4e9e-bf3a-9f6aaa20c0f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:15.207580 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c0ee110-f48e-4e9e-bf3a-9f6aaa20c0f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:15.208065 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c0ee110-f48e-4e9e-bf3a-9f6aaa20c0f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:15.208502 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c0ee110-f48e-4e9e-bf3a-9f6aaa20c0f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:15.209191 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c0ee110-f48e-4e9e-bf3a-9f6aaa20c0f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:15.209645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c0ee110-f48e-4e9e-bf3a-9f6aaa20c0f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:15.210098 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c0ee110-f48e-4e9e-bf3a-9f6aaa20c0f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:15.339286 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1c0ee110-f48e-4e9e-bf3a-9f6aaa20c0f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:15.347083 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1c0ee110-f48e-4e9e-bf3a-9f6aaa20c0f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.150414 Sep 01 14:10:15.348237 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 563/1123] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:15 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:16.368259 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-386ca3d9-a27e-4721-882e-f9fcac658bdc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:16.369042 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-386ca3d9-a27e-4721-882e-f9fcac658bdc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:16.375275 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-386ca3d9-a27e-4721-882e-f9fcac658bdc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:16.375763 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-386ca3d9-a27e-4721-882e-f9fcac658bdc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:16.376195 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-386ca3d9-a27e-4721-882e-f9fcac658bdc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:16.376877 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-386ca3d9-a27e-4721-882e-f9fcac658bdc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:16.377331 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-386ca3d9-a27e-4721-882e-f9fcac658bdc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:16.377756 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-386ca3d9-a27e-4721-882e-f9fcac658bdc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:16.508055 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-386ca3d9-a27e-4721-882e-f9fcac658bdc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:16.516034 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-386ca3d9-a27e-4721-882e-f9fcac658bdc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.151640 Sep 01 14:10:16.516608 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 561/1124] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:16 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:17.537425 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-748150dc-181e-4a48-ad63-10c16c6406da tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:17.538095 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-748150dc-181e-4a48-ad63-10c16c6406da tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:17.544635 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-748150dc-181e-4a48-ad63-10c16c6406da tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:17.545167 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-748150dc-181e-4a48-ad63-10c16c6406da tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:17.545608 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-748150dc-181e-4a48-ad63-10c16c6406da tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:17.546344 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-748150dc-181e-4a48-ad63-10c16c6406da tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:17.546803 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-748150dc-181e-4a48-ad63-10c16c6406da tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:17.547231 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-748150dc-181e-4a48-ad63-10c16c6406da tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:17.678858 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-748150dc-181e-4a48-ad63-10c16c6406da tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:17.686605 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-748150dc-181e-4a48-ad63-10c16c6406da tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.153832 Sep 01 14:10:17.687172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 564/1125] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:17 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:18.707623 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4ed56af5-f438-41ec-96ef-352f441a127f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:18.708242 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4ed56af5-f438-41ec-96ef-352f441a127f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:18.714775 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4ed56af5-f438-41ec-96ef-352f441a127f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:18.715271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4ed56af5-f438-41ec-96ef-352f441a127f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:18.715709 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4ed56af5-f438-41ec-96ef-352f441a127f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:18.716492 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4ed56af5-f438-41ec-96ef-352f441a127f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:18.716905 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4ed56af5-f438-41ec-96ef-352f441a127f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:18.717334 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4ed56af5-f438-41ec-96ef-352f441a127f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:18.846748 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4ed56af5-f438-41ec-96ef-352f441a127f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:18.855466 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4ed56af5-f438-41ec-96ef-352f441a127f tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.152301 Sep 01 14:10:18.856386 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 562/1126] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:18 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:19.876764 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8dbcd41b-84c7-4861-9e0c-3897411e89f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:19.877346 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8dbcd41b-84c7-4861-9e0c-3897411e89f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:19.884298 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8dbcd41b-84c7-4861-9e0c-3897411e89f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:19.884781 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8dbcd41b-84c7-4861-9e0c-3897411e89f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:19.885217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8dbcd41b-84c7-4861-9e0c-3897411e89f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:19.885931 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8dbcd41b-84c7-4861-9e0c-3897411e89f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:19.886387 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8dbcd41b-84c7-4861-9e0c-3897411e89f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:19.886818 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8dbcd41b-84c7-4861-9e0c-3897411e89f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:20.022521 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8dbcd41b-84c7-4861-9e0c-3897411e89f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:20.030408 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8dbcd41b-84c7-4861-9e0c-3897411e89f2 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.157509 Sep 01 14:10:20.030966 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 565/1127] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:19 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:21.051460 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-799b567c-aaf4-4d11-aef9-9edf3bfc4385 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:21.052100 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-799b567c-aaf4-4d11-aef9-9edf3bfc4385 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:21.058571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-799b567c-aaf4-4d11-aef9-9edf3bfc4385 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:21.059125 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-799b567c-aaf4-4d11-aef9-9edf3bfc4385 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:21.059506 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-799b567c-aaf4-4d11-aef9-9edf3bfc4385 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:21.060204 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-799b567c-aaf4-4d11-aef9-9edf3bfc4385 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:21.060655 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-799b567c-aaf4-4d11-aef9-9edf3bfc4385 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:21.061093 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-799b567c-aaf4-4d11-aef9-9edf3bfc4385 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:21.190893 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-799b567c-aaf4-4d11-aef9-9edf3bfc4385 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:21.199511 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-799b567c-aaf4-4d11-aef9-9edf3bfc4385 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.152480 Sep 01 14:10:21.200361 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 563/1128] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:21 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:21.247695 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-97cc64cb-e04a-4888-a83f-5a8e4c3736c0 req-76320489-44de-42d1-b333-ade1d8cc2b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f710322-34af-40ae-a950-149eb3bb046f", "name": "network-vif-plugged", "status": "completed", "tag": "68110cb3-0eb0-4eb4-8f49-ca2a724cfc7a"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:21.258986 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-97cc64cb-e04a-4888-a83f-5a8e4c3736c0 req-76320489-44de-42d1-b333-ade1d8cc2b2d service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:21.259471 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-97cc64cb-e04a-4888-a83f-5a8e4c3736c0 req-76320489-44de-42d1-b333-ade1d8cc2b2d service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:21.259910 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-97cc64cb-e04a-4888-a83f-5a8e4c3736c0 req-76320489-44de-42d1-b333-ade1d8cc2b2d service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:21.272369 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-97cc64cb-e04a-4888-a83f-5a8e4c3736c0 req-76320489-44de-42d1-b333-ade1d8cc2b2d service nova] Creating event network-vif-plugged:68110cb3-0eb0-4eb4-8f49-ca2a724cfc7a for instance 2f710322-34af-40ae-a950-149eb3bb046f on hv-cinder-85221 Sep 01 14:10:21.278122 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-97cc64cb-e04a-4888-a83f-5a8e4c3736c0 req-76320489-44de-42d1-b333-ade1d8cc2b2d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034010 Sep 01 14:10:21.278753 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 566/1129] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:22.220166 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ceb9f662-351e-44ff-a965-c09022dc752e tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:22.220777 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ceb9f662-351e-44ff-a965-c09022dc752e tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:22.223866 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=27 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:22.228856 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ceb9f662-351e-44ff-a965-c09022dc752e tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:22.229336 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ceb9f662-351e-44ff-a965-c09022dc752e tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:22.229793 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ceb9f662-351e-44ff-a965-c09022dc752e tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:22.230493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ceb9f662-351e-44ff-a965-c09022dc752e tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:22.230945 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ceb9f662-351e-44ff-a965-c09022dc752e tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:22.231366 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ceb9f662-351e-44ff-a965-c09022dc752e tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:22.235290 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:22.364592 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ceb9f662-351e-44ff-a965-c09022dc752e tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:22.372402 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ceb9f662-351e-44ff-a965-c09022dc752e tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.156111 Sep 01 14:10:22.372999 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 564/1130] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:22 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:23.395698 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-57aaaa16-239a-450f-9475-433e1f6efeb7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:23.395698 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-57aaaa16-239a-450f-9475-433e1f6efeb7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:23.402886 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57aaaa16-239a-450f-9475-433e1f6efeb7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:23.403380 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57aaaa16-239a-450f-9475-433e1f6efeb7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:23.403824 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57aaaa16-239a-450f-9475-433e1f6efeb7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:23.404538 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57aaaa16-239a-450f-9475-433e1f6efeb7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:23.405000 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57aaaa16-239a-450f-9475-433e1f6efeb7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:23.405430 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57aaaa16-239a-450f-9475-433e1f6efeb7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:23.543527 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-57aaaa16-239a-450f-9475-433e1f6efeb7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:23.552438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-57aaaa16-239a-450f-9475-433e1f6efeb7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1314 microversion: 2.1 time: 0.161914 Sep 01 14:10:23.555157 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 567/1131] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:23 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:24.575342 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-c805e2ef-396a-44a9-9f38-108d5938b9ca tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:24.576081 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-c805e2ef-396a-44a9-9f38-108d5938b9ca tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:24.576494 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e836a0db-7835-4822-851f-3575f160a950 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:24.577311 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e836a0db-7835-4822-851f-3575f160a950 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:24.584897 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c805e2ef-396a-44a9-9f38-108d5938b9ca tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:24.585288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e836a0db-7835-4822-851f-3575f160a950 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:24.585488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c805e2ef-396a-44a9-9f38-108d5938b9ca tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:24.585759 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e836a0db-7835-4822-851f-3575f160a950 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:24.585954 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c805e2ef-396a-44a9-9f38-108d5938b9ca tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:24.586322 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e836a0db-7835-4822-851f-3575f160a950 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:24.586786 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c805e2ef-396a-44a9-9f38-108d5938b9ca tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:24.586958 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e836a0db-7835-4822-851f-3575f160a950 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:24.587295 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c805e2ef-396a-44a9-9f38-108d5938b9ca tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:24.587648 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e836a0db-7835-4822-851f-3575f160a950 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:24.587784 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-c805e2ef-396a-44a9-9f38-108d5938b9ca tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:24.587921 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e836a0db-7835-4822-851f-3575f160a950 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:24.674984 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-e836a0db-7835-4822-851f-3575f160a950 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lazy-loading 'services' on Instance uuid 1c438dca-5d0e-40bc-b802-75ff523b6402 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:10:24.735690 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-c805e2ef-396a-44a9-9f38-108d5938b9ca tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:24.744143 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-c805e2ef-396a-44a9-9f38-108d5938b9ca tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1464 microversion: 2.1 time: 0.173508 Sep 01 14:10:24.745048 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 565/1132] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:24 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1464 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:24.789726 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-13804d52-d92b-4c0d-8baa-09d270b759c1 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:24.796184 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-13804d52-d92b-4c0d-8baa-09d270b759c1 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:24.796515 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13804d52-d92b-4c0d-8baa-09d270b759c1 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:24.796999 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13804d52-d92b-4c0d-8baa-09d270b759c1 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:24.797444 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13804d52-d92b-4c0d-8baa-09d270b759c1 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:24.798166 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13804d52-d92b-4c0d-8baa-09d270b759c1 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:24.798627 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13804d52-d92b-4c0d-8baa-09d270b759c1 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:24.799052 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-13804d52-d92b-4c0d-8baa-09d270b759c1 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:24.830592 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-13804d52-d92b-4c0d-8baa-09d270b759c1 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Going to try to terminate instance {{(pid=127811) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:10:24.986723 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e836a0db-7835-4822-851f-3575f160a950 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402/os-volume_attachments/f68708c7-277c-4e3b-a216-72c70527b31f" status: 202 len: 0 microversion: 2.1 time: 0.415139 Sep 01 14:10:24.987502 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 568/1133] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 1 14:10:24 2022] DELETE /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402/os-volume_attachments/f68708c7-277c-4e3b-a216-72c70527b31f => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:10:25.198367 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-13804d52-d92b-4c0d-8baa-09d270b759c1 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 204 len: 0 microversion: 2.1 time: 0.413145 Sep 01 14:10:25.198962 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 566/1134] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:10:24 2022] DELETE /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:10:25.208783 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f0b27dc4-877c-4457-9095-40945988d0d9 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:25.209488 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f0b27dc4-877c-4457-9095-40945988d0d9 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:25.215827 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f0b27dc4-877c-4457-9095-40945988d0d9 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:25.216291 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f0b27dc4-877c-4457-9095-40945988d0d9 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:25.216734 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f0b27dc4-877c-4457-9095-40945988d0d9 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:25.217433 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f0b27dc4-877c-4457-9095-40945988d0d9 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:25.217933 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f0b27dc4-877c-4457-9095-40945988d0d9 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:25.218444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f0b27dc4-877c-4457-9095-40945988d0d9 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:25.352841 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f0b27dc4-877c-4457-9095-40945988d0d9 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:25.360594 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f0b27dc4-877c-4457-9095-40945988d0d9 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1470 microversion: 2.1 time: 0.156609 Sep 01 14:10:25.361163 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 569/1135] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:25 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:26.383438 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-77d56851-7610-4440-8af9-d3d0c2ee7dfc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:26.384125 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-77d56851-7610-4440-8af9-d3d0c2ee7dfc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:26.391024 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-77d56851-7610-4440-8af9-d3d0c2ee7dfc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:26.391554 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-77d56851-7610-4440-8af9-d3d0c2ee7dfc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:26.391997 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-77d56851-7610-4440-8af9-d3d0c2ee7dfc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:26.392741 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-77d56851-7610-4440-8af9-d3d0c2ee7dfc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:26.393200 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-77d56851-7610-4440-8af9-d3d0c2ee7dfc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:26.393640 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-77d56851-7610-4440-8af9-d3d0c2ee7dfc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:26.548430 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-77d56851-7610-4440-8af9-d3d0c2ee7dfc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:26.556968 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-77d56851-7610-4440-8af9-d3d0c2ee7dfc tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1470 microversion: 2.1 time: 0.178593 Sep 01 14:10:26.557583 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 567/1136] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:26 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1470 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:27.361211 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-544062e7-9491-41ba-91be-acfbf4473a43 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:27.362417 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-544062e7-9491-41ba-91be-acfbf4473a43 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:27.369988 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-544062e7-9491-41ba-91be-acfbf4473a43 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:27.370334 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-544062e7-9491-41ba-91be-acfbf4473a43 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:27.370770 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-544062e7-9491-41ba-91be-acfbf4473a43 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:27.371596 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-544062e7-9491-41ba-91be-acfbf4473a43 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:27.372049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-544062e7-9491-41ba-91be-acfbf4473a43 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:27.372541 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-544062e7-9491-41ba-91be-acfbf4473a43 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:27.401392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-544062e7-9491-41ba-91be-acfbf4473a43 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Going to try to terminate instance {{(pid=127812) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:10:27.579163 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7fdf54f3-f8bf-4919-9822-b1fc0582d6a7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:27.579776 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7fdf54f3-f8bf-4919-9822-b1fc0582d6a7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:27.586515 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7fdf54f3-f8bf-4919-9822-b1fc0582d6a7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:27.587002 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7fdf54f3-f8bf-4919-9822-b1fc0582d6a7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:27.587442 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7fdf54f3-f8bf-4919-9822-b1fc0582d6a7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:27.588132 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7fdf54f3-f8bf-4919-9822-b1fc0582d6a7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:27.588586 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7fdf54f3-f8bf-4919-9822-b1fc0582d6a7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:27.589013 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7fdf54f3-f8bf-4919-9822-b1fc0582d6a7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:27.835552 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7fdf54f3-f8bf-4919-9822-b1fc0582d6a7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:27.843525 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7fdf54f3-f8bf-4919-9822-b1fc0582d6a7 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1470 microversion: 2.1 time: 0.268228 Sep 01 14:10:27.844095 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 568/1137] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:27 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:27.849493 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-033f4ad0-464d-4b3a-8e53-2e24fed47fe3 req-e816e370-91c8-4985-a4be-31d5468c104f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f710322-34af-40ae-a950-149eb3bb046f", "name": "network-vif-deleted", "tag": "68110cb3-0eb0-4eb4-8f49-ca2a724cfc7a"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:27.859111 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-033f4ad0-464d-4b3a-8e53-2e24fed47fe3 req-e816e370-91c8-4985-a4be-31d5468c104f service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:27.859596 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-033f4ad0-464d-4b3a-8e53-2e24fed47fe3 req-e816e370-91c8-4985-a4be-31d5468c104f service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:27.860021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-033f4ad0-464d-4b3a-8e53-2e24fed47fe3 req-e816e370-91c8-4985-a4be-31d5468c104f service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:27.871491 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-033f4ad0-464d-4b3a-8e53-2e24fed47fe3 req-e816e370-91c8-4985-a4be-31d5468c104f service nova] Creating event network-vif-deleted:68110cb3-0eb0-4eb4-8f49-ca2a724cfc7a for instance 2f710322-34af-40ae-a950-149eb3bb046f on hv-cinder-85221 Sep 01 14:10:27.876701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-033f4ad0-464d-4b3a-8e53-2e24fed47fe3 req-e816e370-91c8-4985-a4be-31d5468c104f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031194 Sep 01 14:10:27.877281 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 569/1138] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:27.947612 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-544062e7-9491-41ba-91be-acfbf4473a43 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 204 len: 0 microversion: 2.1 time: 0.590225 Sep 01 14:10:27.948310 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 570/1139] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:10:27 2022] DELETE /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:10:27.957410 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d8cf4c02-7b45-4dd7-b3dd-ae677bc209b5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:27.962735 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d8cf4c02-7b45-4dd7-b3dd-ae677bc209b5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:27.964412 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cf4c02-7b45-4dd7-b3dd-ae677bc209b5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:27.964893 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cf4c02-7b45-4dd7-b3dd-ae677bc209b5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:27.965325 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cf4c02-7b45-4dd7-b3dd-ae677bc209b5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:27.966069 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cf4c02-7b45-4dd7-b3dd-ae677bc209b5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:27.966516 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cf4c02-7b45-4dd7-b3dd-ae677bc209b5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:27.966934 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d8cf4c02-7b45-4dd7-b3dd-ae677bc209b5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:28.101202 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d8cf4c02-7b45-4dd7-b3dd-ae677bc209b5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:28.109592 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d8cf4c02-7b45-4dd7-b3dd-ae677bc209b5 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1511 microversion: 2.1 time: 0.156794 Sep 01 14:10:28.110223 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 570/1140] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:27 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:28.867637 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-9a33e0b3-a3c9-409c-b061-08beb3bf11fa tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:28.868366 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-9a33e0b3-a3c9-409c-b061-08beb3bf11fa tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:28.870990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:28.876204 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9a33e0b3-a3c9-409c-b061-08beb3bf11fa tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:28.876585 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9a33e0b3-a3c9-409c-b061-08beb3bf11fa tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:28.877028 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9a33e0b3-a3c9-409c-b061-08beb3bf11fa tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:28.877752 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9a33e0b3-a3c9-409c-b061-08beb3bf11fa tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:28.879004 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9a33e0b3-a3c9-409c-b061-08beb3bf11fa tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:28.879437 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-9a33e0b3-a3c9-409c-b061-08beb3bf11fa tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:28.884505 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:28.947996 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-9a33e0b3-a3c9-409c-b061-08beb3bf11fa tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:28.956172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-9a33e0b3-a3c9-409c-b061-08beb3bf11fa tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1299 microversion: 2.1 time: 0.093999 Sep 01 14:10:28.957014 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 571/1141] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:28 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:29.137279 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3750c6d6-e0d7-4619-9eed-9e44a3e11848 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:29.137897 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3750c6d6-e0d7-4619-9eed-9e44a3e11848 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:29.144899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3750c6d6-e0d7-4619-9eed-9e44a3e11848 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:29.145392 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3750c6d6-e0d7-4619-9eed-9e44a3e11848 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:29.145898 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3750c6d6-e0d7-4619-9eed-9e44a3e11848 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:29.146608 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3750c6d6-e0d7-4619-9eed-9e44a3e11848 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:29.147069 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3750c6d6-e0d7-4619-9eed-9e44a3e11848 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:29.147532 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3750c6d6-e0d7-4619-9eed-9e44a3e11848 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:29.287090 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3750c6d6-e0d7-4619-9eed-9e44a3e11848 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:29.295926 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3750c6d6-e0d7-4619-9eed-9e44a3e11848 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1511 microversion: 2.1 time: 0.162903 Sep 01 14:10:29.296510 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 571/1142] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:29 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:29.977708 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a2e7e4a3-6f0b-4d4b-b2f5-4be208bf0498 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:29.978419 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a2e7e4a3-6f0b-4d4b-b2f5-4be208bf0498 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:29.985750 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a2e7e4a3-6f0b-4d4b-b2f5-4be208bf0498 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:29.991700 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a2e7e4a3-6f0b-4d4b-b2f5-4be208bf0498 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:29.991700 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a2e7e4a3-6f0b-4d4b-b2f5-4be208bf0498 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:29.991700 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a2e7e4a3-6f0b-4d4b-b2f5-4be208bf0498 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:29.991700 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a2e7e4a3-6f0b-4d4b-b2f5-4be208bf0498 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:29.992072 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a2e7e4a3-6f0b-4d4b-b2f5-4be208bf0498 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:30.053002 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a2e7e4a3-6f0b-4d4b-b2f5-4be208bf0498 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:30.060997 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a2e7e4a3-6f0b-4d4b-b2f5-4be208bf0498 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1299 microversion: 2.1 time: 0.087760 Sep 01 14:10:30.061568 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 572/1143] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:29 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:30.317995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8f0236fe-0f4b-4550-9010-1d37731d3a6b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:30.318617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8f0236fe-0f4b-4550-9010-1d37731d3a6b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:30.324753 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8f0236fe-0f4b-4550-9010-1d37731d3a6b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:30.325242 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8f0236fe-0f4b-4550-9010-1d37731d3a6b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:30.325682 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8f0236fe-0f4b-4550-9010-1d37731d3a6b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:30.326403 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8f0236fe-0f4b-4550-9010-1d37731d3a6b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:30.326860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8f0236fe-0f4b-4550-9010-1d37731d3a6b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:30.327286 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8f0236fe-0f4b-4550-9010-1d37731d3a6b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:30.464567 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-8f0236fe-0f4b-4550-9010-1d37731d3a6b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:30.472903 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8f0236fe-0f4b-4550-9010-1d37731d3a6b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1511 microversion: 2.1 time: 0.159133 Sep 01 14:10:30.473506 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 572/1144] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:30 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:31.083703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c79fcfc9-aea7-4dad-a0c4-4beab308d313 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:31.084313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c79fcfc9-aea7-4dad-a0c4-4beab308d313 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:31.091550 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c79fcfc9-aea7-4dad-a0c4-4beab308d313 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:31.092036 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c79fcfc9-aea7-4dad-a0c4-4beab308d313 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:31.092476 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c79fcfc9-aea7-4dad-a0c4-4beab308d313 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:31.093175 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c79fcfc9-aea7-4dad-a0c4-4beab308d313 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:31.093633 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c79fcfc9-aea7-4dad-a0c4-4beab308d313 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:31.094094 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c79fcfc9-aea7-4dad-a0c4-4beab308d313 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:31.352744 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c79fcfc9-aea7-4dad-a0c4-4beab308d313 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d333e453a8d4df8a1f58d6ffe30fce7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442a8080466045d1ac6d252642b56208', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:31.360966 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c79fcfc9-aea7-4dad-a0c4-4beab308d313 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 200 len: 1299 microversion: 2.1 time: 0.282181 Sep 01 14:10:31.361535 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 573/1145] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:31 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 1299 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:31.500364 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ccb51fba-b1ee-4421-9cf6-250392472d22 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:31.500989 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ccb51fba-b1ee-4421-9cf6-250392472d22 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:31.509910 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ccb51fba-b1ee-4421-9cf6-250392472d22 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:31.509910 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ccb51fba-b1ee-4421-9cf6-250392472d22 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:31.509910 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ccb51fba-b1ee-4421-9cf6-250392472d22 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:31.510246 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ccb51fba-b1ee-4421-9cf6-250392472d22 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:31.510750 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ccb51fba-b1ee-4421-9cf6-250392472d22 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:31.511356 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ccb51fba-b1ee-4421-9cf6-250392472d22 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:31.733512 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ccb51fba-b1ee-4421-9cf6-250392472d22 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:31.742269 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ccb51fba-b1ee-4421-9cf6-250392472d22 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1511 microversion: 2.1 time: 0.249035 Sep 01 14:10:31.743037 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 573/1146] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:31 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1511 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:32.381469 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7713a33f-e1f5-4b77-b812-61c81cd964e8 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:32.382192 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7713a33f-e1f5-4b77-b812-61c81cd964e8 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] [instance: 2f710322-34af-40ae-a950-149eb3bb046f] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:32.389127 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7713a33f-e1f5-4b77-b812-61c81cd964e8 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.389624 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7713a33f-e1f5-4b77-b812-61c81cd964e8 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.390197 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7713a33f-e1f5-4b77-b812-61c81cd964e8 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.391105 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7713a33f-e1f5-4b77-b812-61c81cd964e8 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.391725 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7713a33f-e1f5-4b77-b812-61c81cd964e8 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.392165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7713a33f-e1f5-4b77-b812-61c81cd964e8 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.403181 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-5012107c-acfa-43e6-9ad8-8f7ea975122a req-60b86323-146d-4f79-aca5-69ba715add17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c438dca-5d0e-40bc-b802-75ff523b6402", "name": "network-vif-deleted", "tag": "7d5c2c45-c592-465c-92ec-293116f96fea"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:32.407386 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-7713a33f-e1f5-4b77-b812-61c81cd964e8 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] HTTP exception thrown: Instance 2f710322-34af-40ae-a950-149eb3bb046f could not be found. Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7713a33f-e1f5-4b77-b812-61c81cd964e8 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Request method failure captured: Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f HTTP/1.1 Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjEL00iCCZhqxncAVzQUwu9hcHGwIAcDCphBJ1pQ_qMyY-yJ2BIP-u3n3k0W656WuKWtaHlwcN--A7V1gOr21XoWAmIcZJzDp0-xRIe6LZ1EuG2u41yNFW4zkmhnGt9EGpIWKj01Esiej8Bt_cDz5K-u3F8Kb-pUE9kdXf1RSVbqY5rC8 Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 442a8080466045d1ac6d252642b56208 Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-VolumesNegativeTest-1573283059 Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:10:32.409049 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:10:32.411290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/442a8080466045d1ac6d252642b56208"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/442a8080466045d1ac6d252642b56208"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/442a8080466045d1ac6d252642b56208"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_442a8080466045d1ac6d252642b56208"}]}] Sep 01 14:10:32.411290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-VolumesNegativeTest-1573283059 Sep 01 14:10:32.411290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 442a8080466045d1ac6d252642b56208 Sep 01 14:10:32.411290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-VolumesNegativeTest-1573283059 Sep 01 14:10:32.411290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-VolumesNegativeTest-1573283059-project Sep 01 14:10:32.411290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:10:32.411290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:10:32.411290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 1d333e453a8d4df8a1f58d6ffe30fce7 Sep 01 14:10:32.411290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-VolumesNegativeTest-1573283059-project Sep 01 14:10:32.411290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:10:32.411290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 2f710322-34af-40ae-a950-149eb3bb046f could not be found. Sep 01 14:10:32.411290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '2f710322-34af-40ae-a950-149eb3bb046f'} Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f710322-34af-40ae-a950-149eb3bb046f could not be found. Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:10:32.412158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f710322-34af-40ae-a950-149eb3bb046f could not be found. Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f710322-34af-40ae-a950-149eb3bb046f could not be found. Sep 01 14:10:32.413658 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:10:32.415803 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7713a33f-e1f5-4b77-b812-61c81cd964e8 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] Returning 404 to user: Instance 2f710322-34af-40ae-a950-149eb3bb046f could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:10:32.415803 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7713a33f-e1f5-4b77-b812-61c81cd964e8 tempest-VolumesNegativeTest-1573283059 tempest-VolumesNegativeTest-1573283059-project] 10.222.0.61 "GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f" status: 404 len: 111 microversion: 2.1 time: 0.033759 Sep 01 14:10:32.416027 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-5012107c-acfa-43e6-9ad8-8f7ea975122a req-60b86323-146d-4f79-aca5-69ba715add17 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.416027 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-5012107c-acfa-43e6-9ad8-8f7ea975122a req-60b86323-146d-4f79-aca5-69ba715add17 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.416027 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-5012107c-acfa-43e6-9ad8-8f7ea975122a req-60b86323-146d-4f79-aca5-69ba715add17 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.424179 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 574/1147] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:32 2022] GET /compute/v2.1/servers/2f710322-34af-40ae-a950-149eb3bb046f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:10:32.428820 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-5012107c-acfa-43e6-9ad8-8f7ea975122a req-60b86323-146d-4f79-aca5-69ba715add17 service nova] Creating event network-vif-deleted:7d5c2c45-c592-465c-92ec-293116f96fea for instance 1c438dca-5d0e-40bc-b802-75ff523b6402 on hv-cinder-85221 Sep 01 14:10:32.434019 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-5012107c-acfa-43e6-9ad8-8f7ea975122a req-60b86323-146d-4f79-aca5-69ba715add17 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034424 Sep 01 14:10:32.435053 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 574/1148] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:10:32.764044 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5dbe406a-1eb2-429a-9243-83c2327c6285 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:32.764655 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5dbe406a-1eb2-429a-9243-83c2327c6285 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:32.770759 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5dbe406a-1eb2-429a-9243-83c2327c6285 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.771274 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5dbe406a-1eb2-429a-9243-83c2327c6285 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.771719 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5dbe406a-1eb2-429a-9243-83c2327c6285 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.772416 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5dbe406a-1eb2-429a-9243-83c2327c6285 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:32.772921 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5dbe406a-1eb2-429a-9243-83c2327c6285 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:32.773352 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5dbe406a-1eb2-429a-9243-83c2327c6285 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:32.851336 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5dbe406a-1eb2-429a-9243-83c2327c6285 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:32.872101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5dbe406a-1eb2-429a-9243-83c2327c6285 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1302 microversion: 2.1 time: 0.105766 Sep 01 14:10:32.872101 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 575/1149] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:32 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1302 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:33.892016 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:33.892742 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:33.899665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:33.900151 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:33.900584 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:33.901277 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:33.901721 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:33.902206 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:33.947738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:33.948236 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:33.948676 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:33.949125 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lazy-loading 'fault' on Instance uuid 1c438dca-5d0e-40bc-b802-75ff523b6402 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:10:34.043900 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:34.051818 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-55bb1672-772d-4b0d-8cfe-8a3d243317ad tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 200 len: 1307 microversion: 2.1 time: 0.164268 Sep 01 14:10:34.052382 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 575/1150] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:33 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 1307 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:35.072560 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6c04051c-0846-46ce-8c43-92ca678154a9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:35.073165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-6c04051c-0846-46ce-8c43-92ca678154a9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 1c438dca-5d0e-40bc-b802-75ff523b6402] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:35.081296 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6c04051c-0846-46ce-8c43-92ca678154a9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:35.084452 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6c04051c-0846-46ce-8c43-92ca678154a9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:35.084452 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6c04051c-0846-46ce-8c43-92ca678154a9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:35.084452 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6c04051c-0846-46ce-8c43-92ca678154a9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:35.084452 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6c04051c-0846-46ce-8c43-92ca678154a9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:35.084896 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-6c04051c-0846-46ce-8c43-92ca678154a9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:35.098754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-6c04051c-0846-46ce-8c43-92ca678154a9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] HTTP exception thrown: Instance 1c438dca-5d0e-40bc-b802-75ff523b6402 could not be found. Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6c04051c-0846-46ce-8c43-92ca678154a9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Request method failure captured: Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 HTTP/1.1 Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjEL0Ge7opJzzNEobDQ3ina6AAjtpSE6vdkcapE8pfH4yKs1x5IOfK3P_w_nBT1DTTp3QSpzalIe5tHiYFc9Tpj1nSB_xflMY0kaQBhU_gWSErncRAxtFvzeEgYSH8b9dS6EB0G0q5e2zfXDhluJVaF7-wfwEiLggVmqECW8fA2LVG0y4 Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 035b87bdd94646d0aed7727e587ab40f Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-VolumesSnapshotTestJSON-840298032 Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:10:35.100389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:10:35.102050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/035b87bdd94646d0aed7727e587ab40f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/035b87bdd94646d0aed7727e587ab40f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/035b87bdd94646d0aed7727e587ab40f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_035b87bdd94646d0aed7727e587ab40f"}]}] Sep 01 14:10:35.102050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-VolumesSnapshotTestJSON-840298032 Sep 01 14:10:35.102050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 035b87bdd94646d0aed7727e587ab40f Sep 01 14:10:35.102050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-840298032 Sep 01 14:10:35.102050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-VolumesSnapshotTestJSON-840298032-project Sep 01 14:10:35.102050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:10:35.102050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:10:35.102050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 35383b224a5a46de87c41b49fe1bd037 Sep 01 14:10:35.102050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-VolumesSnapshotTestJSON-840298032-project Sep 01 14:10:35.102050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:10:35.102050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 1c438dca-5d0e-40bc-b802-75ff523b6402 could not be found. Sep 01 14:10:35.102050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '1c438dca-5d0e-40bc-b802-75ff523b6402'} Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c438dca-5d0e-40bc-b802-75ff523b6402 could not be found. Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:10:35.103021 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c438dca-5d0e-40bc-b802-75ff523b6402 could not be found. Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c438dca-5d0e-40bc-b802-75ff523b6402 could not be found. Sep 01 14:10:35.104536 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:10:35.105948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-6c04051c-0846-46ce-8c43-92ca678154a9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Returning 404 to user: Instance 1c438dca-5d0e-40bc-b802-75ff523b6402 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:10:35.105948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-6c04051c-0846-46ce-8c43-92ca678154a9 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402" status: 404 len: 111 microversion: 2.1 time: 0.033290 Sep 01 14:10:35.105948 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 576/1151] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:35 2022] GET /compute/v2.1/servers/1c438dca-5d0e-40bc-b802-75ff523b6402 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:10:36.203987 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1618433595", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1757307735", "security_groups": [{"name": "tempest-secgroup-smoke-541905587"}], "block_device_mapping_v2": [{"uuid": "0ee5015f-b7cb-4df2-b500-2baa16c4c097", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7c0e430-8712-4da5-b970-a9a556e70461"}]}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:36.335701 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.network.neutron [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] validate_networks() for [('e7c0e430-8712-4da5-b970-a9a556e70461', None, None, None, None, None)] {{(pid=127811) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:10:36.730522 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Flavor limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:10:36.730999 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Image limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:10:36.731780 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Flavor pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:10:36.732255 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Image pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:10:36.732680 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:10:36.742229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:36.742719 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:36.743154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:36.743877 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:36.744330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:36.744880 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:36.763457 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Getting quotas for project 9086ba5c610d4954a238d6569ec32f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:10:36.767434 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Getting quotas for user 748b8b4771ac498a88fdd98c8a4914ad and project 9086ba5c610d4954a238d6569ec32f0b. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:10:36.828505 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Going to run 1 instances... {{(pid=127811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:10:36.830691 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ee5015f-b7cb-4df2-b500-2baa16c4c097',volume_size=None,volume_type=None)] {{(pid=127811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:10:37.491856 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-416eb98f-e66d-455d-9e64-e66242ee1e77 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.291744 Sep 01 14:10:37.493209 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 576/1152] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:10:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 14:10:37.504375 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-69f8c779-a728-4a90-8c84-17921326b63a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:37.506274 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-69f8c779-a728-4a90-8c84-17921326b63a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:37.563787 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-69f8c779-a728-4a90-8c84-17921326b63a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:37.571314 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-69f8c779-a728-4a90-8c84-17921326b63a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1095 microversion: 2.1 time: 0.071457 Sep 01 14:10:37.572089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 577/1153] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:37 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:38.592789 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ad9674a7-cd43-4c6f-88d3-45f338a792e3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:38.595997 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ad9674a7-cd43-4c6f-88d3-45f338a792e3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:38.600507 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ad9674a7-cd43-4c6f-88d3-45f338a792e3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:38.600998 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ad9674a7-cd43-4c6f-88d3-45f338a792e3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:38.601471 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ad9674a7-cd43-4c6f-88d3-45f338a792e3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:38.602196 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ad9674a7-cd43-4c6f-88d3-45f338a792e3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:38.602661 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ad9674a7-cd43-4c6f-88d3-45f338a792e3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:38.603089 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ad9674a7-cd43-4c6f-88d3-45f338a792e3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:38.664248 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ad9674a7-cd43-4c6f-88d3-45f338a792e3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:38.672120 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ad9674a7-cd43-4c6f-88d3-45f338a792e3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1145 microversion: 2.1 time: 0.083928 Sep 01 14:10:38.672686 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 577/1154] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:38 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:39.692967 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1b076927-772c-4033-92aa-586db961ef3a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:39.693602 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1b076927-772c-4033-92aa-586db961ef3a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:39.701437 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1b076927-772c-4033-92aa-586db961ef3a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:39.701951 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1b076927-772c-4033-92aa-586db961ef3a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:39.702391 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1b076927-772c-4033-92aa-586db961ef3a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:39.703093 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1b076927-772c-4033-92aa-586db961ef3a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:39.703697 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1b076927-772c-4033-92aa-586db961ef3a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:39.703971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1b076927-772c-4033-92aa-586db961ef3a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:39.767108 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1b076927-772c-4033-92aa-586db961ef3a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:39.775627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1b076927-772c-4033-92aa-586db961ef3a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1193 microversion: 2.1 time: 0.087090 Sep 01 14:10:39.776189 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 578/1155] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:39 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1193 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:40.801646 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-105084d3-f357-41dd-84b9-abd9335f575b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:40.802573 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-105084d3-f357-41dd-84b9-abd9335f575b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:40.809105 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-105084d3-f357-41dd-84b9-abd9335f575b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:40.809595 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-105084d3-f357-41dd-84b9-abd9335f575b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:40.810075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-105084d3-f357-41dd-84b9-abd9335f575b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:40.810780 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-105084d3-f357-41dd-84b9-abd9335f575b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:40.811239 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-105084d3-f357-41dd-84b9-abd9335f575b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:40.811663 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-105084d3-f357-41dd-84b9-abd9335f575b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:40.878931 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-105084d3-f357-41dd-84b9-abd9335f575b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:40.887078 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-105084d3-f357-41dd-84b9-abd9335f575b tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1201 microversion: 2.1 time: 0.089926 Sep 01 14:10:40.887655 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 578/1156] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:40 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:41.908684 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-327c9535-a963-402c-b2f4-4aa9c15c5602 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:41.910029 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-327c9535-a963-402c-b2f4-4aa9c15c5602 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:41.916618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-327c9535-a963-402c-b2f4-4aa9c15c5602 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:41.917038 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-327c9535-a963-402c-b2f4-4aa9c15c5602 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:41.917478 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-327c9535-a963-402c-b2f4-4aa9c15c5602 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:41.918283 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-327c9535-a963-402c-b2f4-4aa9c15c5602 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:41.918737 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-327c9535-a963-402c-b2f4-4aa9c15c5602 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:41.919166 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-327c9535-a963-402c-b2f4-4aa9c15c5602 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:42.173081 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-327c9535-a963-402c-b2f4-4aa9c15c5602 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:42.184701 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-327c9535-a963-402c-b2f4-4aa9c15c5602 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1278 microversion: 2.1 time: 0.279824 Sep 01 14:10:42.185651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 579/1157] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:41 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1278 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:42.735272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-3aa5c41b-9468-42ab-9e92-d0f829308195 req-3eb1bb42-4460-4414-a371-dfa21e5a48e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5", "tag": "50ff7b68-2816-4b8c-af71-8044a278e226"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:42.746294 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-3aa5c41b-9468-42ab-9e92-d0f829308195 req-3eb1bb42-4460-4414-a371-dfa21e5a48e9 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:42.746799 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-3aa5c41b-9468-42ab-9e92-d0f829308195 req-3eb1bb42-4460-4414-a371-dfa21e5a48e9 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:42.747232 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-3aa5c41b-9468-42ab-9e92-d0f829308195 req-3eb1bb42-4460-4414-a371-dfa21e5a48e9 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:42.761465 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-3aa5c41b-9468-42ab-9e92-d0f829308195 req-3eb1bb42-4460-4414-a371-dfa21e5a48e9 service nova] Creating event network-changed:50ff7b68-2816-4b8c-af71-8044a278e226 for instance 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 on hv-cinder-85221 Sep 01 14:10:42.766417 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-3aa5c41b-9468-42ab-9e92-d0f829308195 req-3eb1bb42-4460-4414-a371-dfa21e5a48e9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034854 Sep 01 14:10:42.767234 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 579/1158] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:43.207057 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-65f97b50-5cb9-4702-927d-f2d0c5842235 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:43.207716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-65f97b50-5cb9-4702-927d-f2d0c5842235 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:43.214324 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-65f97b50-5cb9-4702-927d-f2d0c5842235 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:43.214753 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-65f97b50-5cb9-4702-927d-f2d0c5842235 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:43.215199 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-65f97b50-5cb9-4702-927d-f2d0c5842235 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:43.215897 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-65f97b50-5cb9-4702-927d-f2d0c5842235 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:43.216347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-65f97b50-5cb9-4702-927d-f2d0c5842235 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:43.216770 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-65f97b50-5cb9-4702-927d-f2d0c5842235 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:43.372465 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-65f97b50-5cb9-4702-927d-f2d0c5842235 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:43.381123 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-65f97b50-5cb9-4702-927d-f2d0c5842235 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1278 microversion: 2.1 time: 0.178462 Sep 01 14:10:43.381706 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 580/1159] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:43 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:44.402289 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-67f4bc98-e498-42ff-97be-20fb4fdf742f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:44.402904 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-67f4bc98-e498-42ff-97be-20fb4fdf742f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:44.409861 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67f4bc98-e498-42ff-97be-20fb4fdf742f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:44.410350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67f4bc98-e498-42ff-97be-20fb4fdf742f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:44.410800 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67f4bc98-e498-42ff-97be-20fb4fdf742f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:44.411500 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67f4bc98-e498-42ff-97be-20fb4fdf742f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:44.411954 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67f4bc98-e498-42ff-97be-20fb4fdf742f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:44.412382 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-67f4bc98-e498-42ff-97be-20fb4fdf742f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:44.545553 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-67f4bc98-e498-42ff-97be-20fb4fdf742f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:44.553455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-67f4bc98-e498-42ff-97be-20fb4fdf742f tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1278 microversion: 2.1 time: 0.155982 Sep 01 14:10:44.554083 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 580/1160] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:44 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:45.575230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4d2a9af9-7a13-4f2c-be44-da8220d0f425 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:45.575618 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4d2a9af9-7a13-4f2c-be44-da8220d0f425 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:45.581962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4d2a9af9-7a13-4f2c-be44-da8220d0f425 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:45.582455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4d2a9af9-7a13-4f2c-be44-da8220d0f425 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:45.582895 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4d2a9af9-7a13-4f2c-be44-da8220d0f425 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:45.583610 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4d2a9af9-7a13-4f2c-be44-da8220d0f425 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:45.584161 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4d2a9af9-7a13-4f2c-be44-da8220d0f425 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:45.584730 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4d2a9af9-7a13-4f2c-be44-da8220d0f425 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:45.755646 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4d2a9af9-7a13-4f2c-be44-da8220d0f425 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:45.763636 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4d2a9af9-7a13-4f2c-be44-da8220d0f425 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.192665 Sep 01 14:10:45.764250 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 581/1161] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:45 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:46.312706 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2135450193", "imageRef": "2437dd5f-4881-419c-b5e4-6aeb880169de", "flavorRef": "452", "networks": [{"uuid": "e8cf0167-96de-4152-af09-621779051232"}]}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:46.368273 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.network.neutron [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] validate_networks() for [('e8cf0167-96de-4152-af09-621779051232', None, None, None, None, None)] {{(pid=127811) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:10:46.742856 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Flavor limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:10:46.743280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Image limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:10:46.743780 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Flavor pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:10:46.744189 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Image pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:10:46.744696 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:10:46.753129 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:46.754574 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:46.755317 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:46.755757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:46.756488 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:46.756947 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:46.757372 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:46.774380 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Getting quotas for project 035b87bdd94646d0aed7727e587ab40f. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:10:46.778508 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Getting quotas for user 35383b224a5a46de87c41b49fe1bd037 and project 035b87bdd94646d0aed7727e587ab40f. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:10:46.785029 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2ecd096a-c985-49a7-bc1b-3ebc5d01e600 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:46.785742 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2ecd096a-c985-49a7-bc1b-3ebc5d01e600 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:46.791638 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Going to run 1 instances... {{(pid=127811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:10:46.792318 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2ecd096a-c985-49a7-bc1b-3ebc5d01e600 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:46.792800 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2ecd096a-c985-49a7-bc1b-3ebc5d01e600 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:46.793230 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2ecd096a-c985-49a7-bc1b-3ebc5d01e600 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:46.793955 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2ecd096a-c985-49a7-bc1b-3ebc5d01e600 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:46.794402 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2ecd096a-c985-49a7-bc1b-3ebc5d01e600 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:46.794524 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2437dd5f-4881-419c-b5e4-6aeb880169de',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:10:46.794819 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2ecd096a-c985-49a7-bc1b-3ebc5d01e600 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:46.930245 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2ecd096a-c985-49a7-bc1b-3ebc5d01e600 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:46.932899 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-be312915-ee34-41df-8276-d1a6f42be8a7 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624184 Sep 01 14:10:46.939479 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 581/1162] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:10:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:10:46.945179 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a9e2f156-11a2-487c-8630-f0322c2d87fa tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:46.945604 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2ecd096a-c985-49a7-bc1b-3ebc5d01e600 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.164937 Sep 01 14:10:46.946080 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a9e2f156-11a2-487c-8630-f0322c2d87fa tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:46.946544 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 582/1163] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:46 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:46.999816 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a9e2f156-11a2-487c-8630-f0322c2d87fa tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:47.011255 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a9e2f156-11a2-487c-8630-f0322c2d87fa tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1219 microversion: 2.1 time: 0.069951 Sep 01 14:10:47.011836 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 582/1164] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:46 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:47.967785 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-62ba2249-5b92-49e5-bc63-c8ccd8940faa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:47.968338 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-62ba2249-5b92-49e5-bc63-c8ccd8940faa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:47.970221 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:47.975697 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-62ba2249-5b92-49e5-bc63-c8ccd8940faa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:47.976189 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-62ba2249-5b92-49e5-bc63-c8ccd8940faa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:47.976631 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-62ba2249-5b92-49e5-bc63-c8ccd8940faa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:47.977398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-62ba2249-5b92-49e5-bc63-c8ccd8940faa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:47.977873 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-62ba2249-5b92-49e5-bc63-c8ccd8940faa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:47.978309 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-62ba2249-5b92-49e5-bc63-c8ccd8940faa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:48.032190 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a8208a6c-66ce-4b9b-914c-f6ab1ae382d4 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:48.032794 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a8208a6c-66ce-4b9b-914c-f6ab1ae382d4 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:48.097196 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a8208a6c-66ce-4b9b-914c-f6ab1ae382d4 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:48.104369 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a8208a6c-66ce-4b9b-914c-f6ab1ae382d4 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1219 microversion: 2.1 time: 0.075905 Sep 01 14:10:48.104824 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 583/1165] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:48 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:48.144466 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-62ba2249-5b92-49e5-bc63-c8ccd8940faa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:48.152318 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-62ba2249-5b92-49e5-bc63-c8ccd8940faa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.189139 Sep 01 14:10:48.152886 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 583/1166] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:47 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:49.125093 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3282a322-1597-4a73-bcba-9512bcff814c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:49.125737 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3282a322-1597-4a73-bcba-9512bcff814c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:49.133222 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3282a322-1597-4a73-bcba-9512bcff814c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:49.133729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3282a322-1597-4a73-bcba-9512bcff814c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:49.134194 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3282a322-1597-4a73-bcba-9512bcff814c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:49.134925 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3282a322-1597-4a73-bcba-9512bcff814c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:49.135453 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3282a322-1597-4a73-bcba-9512bcff814c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:49.135932 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3282a322-1597-4a73-bcba-9512bcff814c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:49.140260 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:49.173448 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8362d835-45c0-4a2d-9425-38aa129ee1ac tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:49.174165 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8362d835-45c0-4a2d-9425-38aa129ee1ac tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:49.181294 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8362d835-45c0-4a2d-9425-38aa129ee1ac tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:49.181809 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8362d835-45c0-4a2d-9425-38aa129ee1ac tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:49.182263 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8362d835-45c0-4a2d-9425-38aa129ee1ac tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:49.183002 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8362d835-45c0-4a2d-9425-38aa129ee1ac tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:49.183704 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8362d835-45c0-4a2d-9425-38aa129ee1ac tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:49.183925 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8362d835-45c0-4a2d-9425-38aa129ee1ac tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:49.203952 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3282a322-1597-4a73-bcba-9512bcff814c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:49.212062 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3282a322-1597-4a73-bcba-9512bcff814c tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1215 microversion: 2.1 time: 0.090867 Sep 01 14:10:49.213043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 584/1167] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:49 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:49.329306 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8362d835-45c0-4a2d-9425-38aa129ee1ac tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:49.334529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8362d835-45c0-4a2d-9425-38aa129ee1ac tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.165488 Sep 01 14:10:49.335327 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 584/1168] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:49 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:10:50.233669 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4b40cafb-89f2-4fa1-b6ee-49c1b0971477 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:50.234298 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4b40cafb-89f2-4fa1-b6ee-49c1b0971477 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:50.241700 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4b40cafb-89f2-4fa1-b6ee-49c1b0971477 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:50.242211 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4b40cafb-89f2-4fa1-b6ee-49c1b0971477 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:50.242645 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4b40cafb-89f2-4fa1-b6ee-49c1b0971477 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:50.243329 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4b40cafb-89f2-4fa1-b6ee-49c1b0971477 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:50.243783 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4b40cafb-89f2-4fa1-b6ee-49c1b0971477 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:50.244205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4b40cafb-89f2-4fa1-b6ee-49c1b0971477 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:50.304954 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4b40cafb-89f2-4fa1-b6ee-49c1b0971477 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:50.313280 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4b40cafb-89f2-4fa1-b6ee-49c1b0971477 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1279 microversion: 2.1 time: 0.083819 Sep 01 14:10:50.313870 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 585/1169] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:50 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1279 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:50.355745 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a3d2ba92-a142-4d5a-b4aa-314bd1c4b1c3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:50.358426 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a3d2ba92-a142-4d5a-b4aa-314bd1c4b1c3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:50.362906 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a3d2ba92-a142-4d5a-b4aa-314bd1c4b1c3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:50.363765 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a3d2ba92-a142-4d5a-b4aa-314bd1c4b1c3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:50.363904 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a3d2ba92-a142-4d5a-b4aa-314bd1c4b1c3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:50.364540 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a3d2ba92-a142-4d5a-b4aa-314bd1c4b1c3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:50.364997 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a3d2ba92-a142-4d5a-b4aa-314bd1c4b1c3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:50.365459 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a3d2ba92-a142-4d5a-b4aa-314bd1c4b1c3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:50.513968 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a3d2ba92-a142-4d5a-b4aa-314bd1c4b1c3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:50.522312 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a3d2ba92-a142-4d5a-b4aa-314bd1c4b1c3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.170450 Sep 01 14:10:50.522881 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 585/1170] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:50 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:51.335513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-5519149b-3e7d-438d-8b03-e6b3bd0f434b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:51.336188 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-5519149b-3e7d-438d-8b03-e6b3bd0f434b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:51.343100 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5519149b-3e7d-438d-8b03-e6b3bd0f434b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:51.343667 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5519149b-3e7d-438d-8b03-e6b3bd0f434b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:51.344113 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5519149b-3e7d-438d-8b03-e6b3bd0f434b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:51.344835 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5519149b-3e7d-438d-8b03-e6b3bd0f434b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:51.345288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5519149b-3e7d-438d-8b03-e6b3bd0f434b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:51.345712 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-5519149b-3e7d-438d-8b03-e6b3bd0f434b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:51.495362 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-5519149b-3e7d-438d-8b03-e6b3bd0f434b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:51.503174 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-5519149b-3e7d-438d-8b03-e6b3bd0f434b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.172787 Sep 01 14:10:51.503752 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 586/1171] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:51 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:51.544239 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-3840f087-78f5-4de9-88fd-a3b63689ffa5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:51.544931 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-3840f087-78f5-4de9-88fd-a3b63689ffa5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:51.552311 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3840f087-78f5-4de9-88fd-a3b63689ffa5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:51.552787 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3840f087-78f5-4de9-88fd-a3b63689ffa5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:51.553217 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3840f087-78f5-4de9-88fd-a3b63689ffa5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:51.553937 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3840f087-78f5-4de9-88fd-a3b63689ffa5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:51.554386 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3840f087-78f5-4de9-88fd-a3b63689ffa5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:51.554806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-3840f087-78f5-4de9-88fd-a3b63689ffa5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:51.682130 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-3840f087-78f5-4de9-88fd-a3b63689ffa5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:51.689743 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-3840f087-78f5-4de9-88fd-a3b63689ffa5 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.149573 Sep 01 14:10:51.690320 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 586/1172] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:51 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:52.524207 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-783a83e3-cf05-4175-aa0b-762530d45cce tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:52.524754 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-783a83e3-cf05-4175-aa0b-762530d45cce tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:52.527015 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:52.531837 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-783a83e3-cf05-4175-aa0b-762530d45cce tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:52.532322 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-783a83e3-cf05-4175-aa0b-762530d45cce tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:52.532759 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-783a83e3-cf05-4175-aa0b-762530d45cce tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:52.533446 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-783a83e3-cf05-4175-aa0b-762530d45cce tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:52.533946 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-783a83e3-cf05-4175-aa0b-762530d45cce tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:52.534374 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-783a83e3-cf05-4175-aa0b-762530d45cce tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:52.668276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-783a83e3-cf05-4175-aa0b-762530d45cce tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:52.676050 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-783a83e3-cf05-4175-aa0b-762530d45cce tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.155844 Sep 01 14:10:52.676612 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 587/1173] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:52 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:52.709605 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f67242cc-0175-4028-865a-11aded8882e7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:52.710270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f67242cc-0175-4028-865a-11aded8882e7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:52.716687 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f67242cc-0175-4028-865a-11aded8882e7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:52.717169 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f67242cc-0175-4028-865a-11aded8882e7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:52.717603 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f67242cc-0175-4028-865a-11aded8882e7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:52.718323 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f67242cc-0175-4028-865a-11aded8882e7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:52.718774 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f67242cc-0175-4028-865a-11aded8882e7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:52.719196 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f67242cc-0175-4028-865a-11aded8882e7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:52.848760 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f67242cc-0175-4028-865a-11aded8882e7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:52.863633 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f67242cc-0175-4028-865a-11aded8882e7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.158271 Sep 01 14:10:52.864232 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 587/1174] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:52 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:53.697185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-33ed1f19-82c2-4ce9-9e87-d7345289e442 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:53.698427 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-33ed1f19-82c2-4ce9-9e87-d7345289e442 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:53.700678 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 14:10:53.700872 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Thu Sep 1 14:10:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 (ip 10.222.0.61) !!! Sep 01 14:10:53.706905 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-33ed1f19-82c2-4ce9-9e87-d7345289e442 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:53.707393 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-33ed1f19-82c2-4ce9-9e87-d7345289e442 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:53.707831 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-33ed1f19-82c2-4ce9-9e87-d7345289e442 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:53.708540 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-33ed1f19-82c2-4ce9-9e87-d7345289e442 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:53.708996 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-33ed1f19-82c2-4ce9-9e87-d7345289e442 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:53.709416 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-33ed1f19-82c2-4ce9-9e87-d7345289e442 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:53.865578 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-33ed1f19-82c2-4ce9-9e87-d7345289e442 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:53.873535 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-33ed1f19-82c2-4ce9-9e87-d7345289e442 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.180288 Sep 01 14:10:53.874140 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 588/1175] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:53 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:53.884806 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f8b3cd8d-0494-4789-87ac-e21cfc2258d0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:53.885418 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f8b3cd8d-0494-4789-87ac-e21cfc2258d0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:53.891962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd8d-0494-4789-87ac-e21cfc2258d0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:53.892549 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd8d-0494-4789-87ac-e21cfc2258d0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:53.893731 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd8d-0494-4789-87ac-e21cfc2258d0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:53.894513 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd8d-0494-4789-87ac-e21cfc2258d0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:53.894975 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd8d-0494-4789-87ac-e21cfc2258d0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:53.895406 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f8b3cd8d-0494-4789-87ac-e21cfc2258d0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:54.115108 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f8b3cd8d-0494-4789-87ac-e21cfc2258d0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:54.122923 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f8b3cd8d-0494-4789-87ac-e21cfc2258d0 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.241982 Sep 01 14:10:54.123527 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 588/1176] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:53 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:54.351966 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-b475bab8-fa54-4e4d-bad1-ad55dbd52f0c req-539c2faf-c197-4f65-bcf9-08d04cc4738c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "834ae1e8-c5d7-4e0e-9ed5-de94869ba807", "tag": "04ae95a5-da52-4220-980e-b647627fc3f9"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:10:54.362467 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-b475bab8-fa54-4e4d-bad1-ad55dbd52f0c req-539c2faf-c197-4f65-bcf9-08d04cc4738c service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:54.362977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-b475bab8-fa54-4e4d-bad1-ad55dbd52f0c req-539c2faf-c197-4f65-bcf9-08d04cc4738c service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:54.363404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-b475bab8-fa54-4e4d-bad1-ad55dbd52f0c req-539c2faf-c197-4f65-bcf9-08d04cc4738c service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:54.374710 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-b475bab8-fa54-4e4d-bad1-ad55dbd52f0c req-539c2faf-c197-4f65-bcf9-08d04cc4738c service nova] Creating event network-changed:04ae95a5-da52-4220-980e-b647627fc3f9 for instance 834ae1e8-c5d7-4e0e-9ed5-de94869ba807 on hv-cinder-85221 Sep 01 14:10:54.381876 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-b475bab8-fa54-4e4d-bad1-ad55dbd52f0c req-539c2faf-c197-4f65-bcf9-08d04cc4738c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034271 Sep 01 14:10:54.382725 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 589/1177] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:10:54.895292 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d2cb7e5b-056d-4f23-8c9f-1f3decba2173 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:54.895876 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d2cb7e5b-056d-4f23-8c9f-1f3decba2173 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:54.902310 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2cb7e5b-056d-4f23-8c9f-1f3decba2173 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:54.902796 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2cb7e5b-056d-4f23-8c9f-1f3decba2173 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:54.903235 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2cb7e5b-056d-4f23-8c9f-1f3decba2173 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:54.903970 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2cb7e5b-056d-4f23-8c9f-1f3decba2173 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:54.904420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2cb7e5b-056d-4f23-8c9f-1f3decba2173 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:54.904842 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d2cb7e5b-056d-4f23-8c9f-1f3decba2173 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:55.062756 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d2cb7e5b-056d-4f23-8c9f-1f3decba2173 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:55.070660 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d2cb7e5b-056d-4f23-8c9f-1f3decba2173 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.179803 Sep 01 14:10:55.071644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 589/1178] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:54 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:55.146044 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a9bafe0b-f790-4885-830b-272de93f8e41 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:55.146634 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a9bafe0b-f790-4885-830b-272de93f8e41 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:55.153014 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a9bafe0b-f790-4885-830b-272de93f8e41 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:55.153506 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a9bafe0b-f790-4885-830b-272de93f8e41 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:55.153995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a9bafe0b-f790-4885-830b-272de93f8e41 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:55.154703 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a9bafe0b-f790-4885-830b-272de93f8e41 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:55.155188 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a9bafe0b-f790-4885-830b-272de93f8e41 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:55.155647 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a9bafe0b-f790-4885-830b-272de93f8e41 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:55.288960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a9bafe0b-f790-4885-830b-272de93f8e41 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:55.296917 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a9bafe0b-f790-4885-830b-272de93f8e41 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.156210 Sep 01 14:10:55.297513 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 590/1179] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:55 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:56.092404 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-787b1587-a954-4469-8091-92637829690e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:56.093023 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-787b1587-a954-4469-8091-92637829690e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:56.099945 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-787b1587-a954-4469-8091-92637829690e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:56.100429 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-787b1587-a954-4469-8091-92637829690e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:56.100866 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-787b1587-a954-4469-8091-92637829690e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:56.101554 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-787b1587-a954-4469-8091-92637829690e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:56.102029 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-787b1587-a954-4469-8091-92637829690e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:56.102460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-787b1587-a954-4469-8091-92637829690e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:56.106336 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=100 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:56.232713 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-787b1587-a954-4469-8091-92637829690e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:56.240470 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-787b1587-a954-4469-8091-92637829690e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.151919 Sep 01 14:10:56.241033 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 590/1180] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:56 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:56.319729 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2d659e38-12e0-4bda-ad01-01f8fe2b27d3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:56.320398 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2d659e38-12e0-4bda-ad01-01f8fe2b27d3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:56.326789 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d659e38-12e0-4bda-ad01-01f8fe2b27d3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:56.327273 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d659e38-12e0-4bda-ad01-01f8fe2b27d3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:56.327712 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d659e38-12e0-4bda-ad01-01f8fe2b27d3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:56.328399 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d659e38-12e0-4bda-ad01-01f8fe2b27d3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:56.328853 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d659e38-12e0-4bda-ad01-01f8fe2b27d3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:56.329276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d659e38-12e0-4bda-ad01-01f8fe2b27d3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:56.457293 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2d659e38-12e0-4bda-ad01-01f8fe2b27d3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:56.465120 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2d659e38-12e0-4bda-ad01-01f8fe2b27d3 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.149961 Sep 01 14:10:56.465682 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 591/1181] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:56 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:57.262054 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d7fb5bc4-4dc1-4e16-8a41-44c42a3946c8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:57.262610 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d7fb5bc4-4dc1-4e16-8a41-44c42a3946c8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:57.269580 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d7fb5bc4-4dc1-4e16-8a41-44c42a3946c8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:57.270134 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d7fb5bc4-4dc1-4e16-8a41-44c42a3946c8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:57.270545 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d7fb5bc4-4dc1-4e16-8a41-44c42a3946c8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:57.271246 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d7fb5bc4-4dc1-4e16-8a41-44c42a3946c8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:57.271703 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d7fb5bc4-4dc1-4e16-8a41-44c42a3946c8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:57.272132 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d7fb5bc4-4dc1-4e16-8a41-44c42a3946c8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:57.405531 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d7fb5bc4-4dc1-4e16-8a41-44c42a3946c8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:57.413817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d7fb5bc4-4dc1-4e16-8a41-44c42a3946c8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.155738 Sep 01 14:10:57.414392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 591/1182] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:57 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:57.485898 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3196b323-24a9-4bdc-ba1b-e7af634d425c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:57.490205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3196b323-24a9-4bdc-ba1b-e7af634d425c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:57.490205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:57.494640 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3196b323-24a9-4bdc-ba1b-e7af634d425c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:57.495170 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3196b323-24a9-4bdc-ba1b-e7af634d425c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:57.495650 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3196b323-24a9-4bdc-ba1b-e7af634d425c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:57.496442 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3196b323-24a9-4bdc-ba1b-e7af634d425c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:57.496927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3196b323-24a9-4bdc-ba1b-e7af634d425c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:57.497373 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3196b323-24a9-4bdc-ba1b-e7af634d425c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:57.628953 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3196b323-24a9-4bdc-ba1b-e7af634d425c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:57.637049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3196b323-24a9-4bdc-ba1b-e7af634d425c tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.155277 Sep 01 14:10:57.637617 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 592/1183] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:57 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:58.434293 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-cd1d18a1-8ab0-4c1b-bc1e-c1029a137f5a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:58.434864 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-cd1d18a1-8ab0-4c1b-bc1e-c1029a137f5a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:58.441957 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cd1d18a1-8ab0-4c1b-bc1e-c1029a137f5a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:58.442458 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cd1d18a1-8ab0-4c1b-bc1e-c1029a137f5a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:58.442866 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cd1d18a1-8ab0-4c1b-bc1e-c1029a137f5a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:58.443553 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cd1d18a1-8ab0-4c1b-bc1e-c1029a137f5a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:58.443998 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cd1d18a1-8ab0-4c1b-bc1e-c1029a137f5a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:58.444416 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-cd1d18a1-8ab0-4c1b-bc1e-c1029a137f5a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:58.572494 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-cd1d18a1-8ab0-4c1b-bc1e-c1029a137f5a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:58.580317 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-cd1d18a1-8ab0-4c1b-bc1e-c1029a137f5a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.149911 Sep 01 14:10:58.581698 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 592/1184] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:58 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:58.659914 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d4cd9046-df0c-416d-bc19-f5f4409a2f72 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:58.660524 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d4cd9046-df0c-416d-bc19-f5f4409a2f72 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:58.662379 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=16 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:10:58.667599 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4cd9046-df0c-416d-bc19-f5f4409a2f72 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:58.668097 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4cd9046-df0c-416d-bc19-f5f4409a2f72 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:58.668515 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4cd9046-df0c-416d-bc19-f5f4409a2f72 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:58.669223 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4cd9046-df0c-416d-bc19-f5f4409a2f72 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:58.669665 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4cd9046-df0c-416d-bc19-f5f4409a2f72 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:58.670113 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d4cd9046-df0c-416d-bc19-f5f4409a2f72 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:58.807212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d4cd9046-df0c-416d-bc19-f5f4409a2f72 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:58.816075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d4cd9046-df0c-416d-bc19-f5f4409a2f72 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.160624 Sep 01 14:10:58.816748 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 593/1185] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:58 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:59.600645 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f99c79dc-f742-45d4-9aaa-7899fe13ec1a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:59.601282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f99c79dc-f742-45d4-9aaa-7899fe13ec1a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:59.607797 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f99c79dc-f742-45d4-9aaa-7899fe13ec1a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:59.618471 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f99c79dc-f742-45d4-9aaa-7899fe13ec1a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:59.618471 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f99c79dc-f742-45d4-9aaa-7899fe13ec1a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:59.618471 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f99c79dc-f742-45d4-9aaa-7899fe13ec1a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:59.618471 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f99c79dc-f742-45d4-9aaa-7899fe13ec1a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:59.618871 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f99c79dc-f742-45d4-9aaa-7899fe13ec1a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:59.743164 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f99c79dc-f742-45d4-9aaa-7899fe13ec1a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:59.750994 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f99c79dc-f742-45d4-9aaa-7899fe13ec1a tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.154193 Sep 01 14:10:59.751553 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 593/1186] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:59 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:10:59.839198 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d1f24613-da6b-40d3-a13e-37d7c7c01751 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:10:59.839807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d1f24613-da6b-40d3-a13e-37d7c7c01751 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:10:59.846685 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1f24613-da6b-40d3-a13e-37d7c7c01751 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:59.847296 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1f24613-da6b-40d3-a13e-37d7c7c01751 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:59.847728 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1f24613-da6b-40d3-a13e-37d7c7c01751 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:59.848409 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1f24613-da6b-40d3-a13e-37d7c7c01751 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:10:59.848940 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1f24613-da6b-40d3-a13e-37d7c7c01751 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:10:59.849273 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1f24613-da6b-40d3-a13e-37d7c7c01751 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:10:59.987979 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d1f24613-da6b-40d3-a13e-37d7c7c01751 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:10:59.995997 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d1f24613-da6b-40d3-a13e-37d7c7c01751 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.160966 Sep 01 14:10:59.996578 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 594/1187] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:10:59 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:00.080871 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-bc8d7cf2-8d6d-4aaf-b538-e0f73a929737 req-0a005c78-66fd-4bcf-832b-9d90cf7a738a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5", "name": "network-vif-plugged", "status": "completed", "tag": "50ff7b68-2816-4b8c-af71-8044a278e226"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:00.090398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-bc8d7cf2-8d6d-4aaf-b538-e0f73a929737 req-0a005c78-66fd-4bcf-832b-9d90cf7a738a service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:00.090880 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-bc8d7cf2-8d6d-4aaf-b538-e0f73a929737 req-0a005c78-66fd-4bcf-832b-9d90cf7a738a service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:00.091312 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-bc8d7cf2-8d6d-4aaf-b538-e0f73a929737 req-0a005c78-66fd-4bcf-832b-9d90cf7a738a service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:00.102067 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-bc8d7cf2-8d6d-4aaf-b538-e0f73a929737 req-0a005c78-66fd-4bcf-832b-9d90cf7a738a service nova] Creating event network-vif-plugged:50ff7b68-2816-4b8c-af71-8044a278e226 for instance 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 on hv-cinder-85221 Sep 01 14:11:00.109365 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-bc8d7cf2-8d6d-4aaf-b538-e0f73a929737 req-0a005c78-66fd-4bcf-832b-9d90cf7a738a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029797 Sep 01 14:11:00.109365 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 594/1188] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:00.772477 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f4f51197-f20b-436c-acb2-7952e2496caf tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:00.773088 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f4f51197-f20b-436c-acb2-7952e2496caf tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:00.779500 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f4f51197-f20b-436c-acb2-7952e2496caf tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:00.779922 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f4f51197-f20b-436c-acb2-7952e2496caf tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:00.780359 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f4f51197-f20b-436c-acb2-7952e2496caf tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:00.781054 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f4f51197-f20b-436c-acb2-7952e2496caf tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:00.781506 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f4f51197-f20b-436c-acb2-7952e2496caf tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:00.782009 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f4f51197-f20b-436c-acb2-7952e2496caf tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:00.909982 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f4f51197-f20b-436c-acb2-7952e2496caf tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:00.917909 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f4f51197-f20b-436c-acb2-7952e2496caf tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.149914 Sep 01 14:11:00.918484 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 595/1189] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:00 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:01.018095 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-468250e9-ef37-442d-83fc-4ac722391584 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:01.018972 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-468250e9-ef37-442d-83fc-4ac722391584 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:01.025236 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468250e9-ef37-442d-83fc-4ac722391584 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:01.025723 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468250e9-ef37-442d-83fc-4ac722391584 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:01.026191 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468250e9-ef37-442d-83fc-4ac722391584 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:01.026957 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468250e9-ef37-442d-83fc-4ac722391584 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:01.027416 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468250e9-ef37-442d-83fc-4ac722391584 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:01.027844 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-468250e9-ef37-442d-83fc-4ac722391584 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:01.164006 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-468250e9-ef37-442d-83fc-4ac722391584 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:01.172010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-468250e9-ef37-442d-83fc-4ac722391584 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.158926 Sep 01 14:11:01.172579 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 595/1190] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:01 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:01.938963 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-53254431-98b1-4049-8e93-00302cda01ba tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:01.939572 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-53254431-98b1-4049-8e93-00302cda01ba tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:01.946594 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-53254431-98b1-4049-8e93-00302cda01ba tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:01.947074 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-53254431-98b1-4049-8e93-00302cda01ba tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:01.947506 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-53254431-98b1-4049-8e93-00302cda01ba tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:01.948193 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-53254431-98b1-4049-8e93-00302cda01ba tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:01.948644 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-53254431-98b1-4049-8e93-00302cda01ba tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:01.949065 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-53254431-98b1-4049-8e93-00302cda01ba tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:02.076534 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-53254431-98b1-4049-8e93-00302cda01ba tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:02.084344 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-53254431-98b1-4049-8e93-00302cda01ba tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.149271 Sep 01 14:11:02.084911 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 596/1191] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:01 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:02.192581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-45f91126-db19-4a1d-995d-8f5aea7da052 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:02.193233 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-45f91126-db19-4a1d-995d-8f5aea7da052 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:02.195735 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=52 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:02.200551 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-45f91126-db19-4a1d-995d-8f5aea7da052 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:02.208546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-45f91126-db19-4a1d-995d-8f5aea7da052 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:02.208546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-45f91126-db19-4a1d-995d-8f5aea7da052 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:02.208546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-45f91126-db19-4a1d-995d-8f5aea7da052 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:02.208546 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-45f91126-db19-4a1d-995d-8f5aea7da052 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:02.208952 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-45f91126-db19-4a1d-995d-8f5aea7da052 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:02.338767 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-45f91126-db19-4a1d-995d-8f5aea7da052 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:02.346725 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-45f91126-db19-4a1d-995d-8f5aea7da052 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.157222 Sep 01 14:11:02.347316 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 596/1192] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:02 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:03.104838 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f77e1feb-0466-4d5b-a7c8-bfa7e764f2f8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:03.105610 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f77e1feb-0466-4d5b-a7c8-bfa7e764f2f8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:03.112510 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f77e1feb-0466-4d5b-a7c8-bfa7e764f2f8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:03.112999 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f77e1feb-0466-4d5b-a7c8-bfa7e764f2f8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:03.113442 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f77e1feb-0466-4d5b-a7c8-bfa7e764f2f8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:03.114173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f77e1feb-0466-4d5b-a7c8-bfa7e764f2f8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:03.114632 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f77e1feb-0466-4d5b-a7c8-bfa7e764f2f8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:03.115063 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f77e1feb-0466-4d5b-a7c8-bfa7e764f2f8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:03.245432 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f77e1feb-0466-4d5b-a7c8-bfa7e764f2f8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:03.254130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f77e1feb-0466-4d5b-a7c8-bfa7e764f2f8 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.153236 Sep 01 14:11:03.254745 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 597/1193] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:03 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:03.367163 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b5b33014-6bba-45e3-b4c4-d46bd36fcd5d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:03.367793 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b5b33014-6bba-45e3-b4c4-d46bd36fcd5d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:03.374302 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5b33014-6bba-45e3-b4c4-d46bd36fcd5d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:03.374781 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5b33014-6bba-45e3-b4c4-d46bd36fcd5d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:03.375216 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5b33014-6bba-45e3-b4c4-d46bd36fcd5d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:03.375908 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5b33014-6bba-45e3-b4c4-d46bd36fcd5d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:03.376357 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5b33014-6bba-45e3-b4c4-d46bd36fcd5d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:03.376779 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b5b33014-6bba-45e3-b4c4-d46bd36fcd5d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:03.517574 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b5b33014-6bba-45e3-b4c4-d46bd36fcd5d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:03.526023 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b5b33014-6bba-45e3-b4c4-d46bd36fcd5d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1266 microversion: 2.1 time: 0.162766 Sep 01 14:11:03.526597 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 597/1194] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:03 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:04.275411 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-88689cb2-6fca-40de-8a59-43119661e404 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:04.276205 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-88689cb2-6fca-40de-8a59-43119661e404 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:04.283372 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-88689cb2-6fca-40de-8a59-43119661e404 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.283873 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-88689cb2-6fca-40de-8a59-43119661e404 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.284317 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-88689cb2-6fca-40de-8a59-43119661e404 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:04.285058 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-88689cb2-6fca-40de-8a59-43119661e404 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.285539 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-88689cb2-6fca-40de-8a59-43119661e404 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.286001 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-88689cb2-6fca-40de-8a59-43119661e404 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:04.419926 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-88689cb2-6fca-40de-8a59-43119661e404 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:04.427780 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-88689cb2-6fca-40de-8a59-43119661e404 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.156502 Sep 01 14:11:04.428351 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 598/1195] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:04 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:04.546816 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-11d72f10-0185-49cd-a8bd-7d170c8d8cc2 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:04.547432 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-11d72f10-0185-49cd-a8bd-7d170c8d8cc2 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:04.554460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11d72f10-0185-49cd-a8bd-7d170c8d8cc2 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.554944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11d72f10-0185-49cd-a8bd-7d170c8d8cc2 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.555384 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11d72f10-0185-49cd-a8bd-7d170c8d8cc2 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:04.556081 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11d72f10-0185-49cd-a8bd-7d170c8d8cc2 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.556534 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11d72f10-0185-49cd-a8bd-7d170c8d8cc2 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.556960 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-11d72f10-0185-49cd-a8bd-7d170c8d8cc2 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:04.689552 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-11d72f10-0185-49cd-a8bd-7d170c8d8cc2 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:04.697324 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-11d72f10-0185-49cd-a8bd-7d170c8d8cc2 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1452 microversion: 2.1 time: 0.154440 Sep 01 14:11:04.697910 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 598/1196] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:04 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:04.718402 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1f2529d2-b314-4063-a03a-3d75b1b1a27d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:04.719015 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1f2529d2-b314-4063-a03a-3d75b1b1a27d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:04.725789 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f2529d2-b314-4063-a03a-3d75b1b1a27d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.726338 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f2529d2-b314-4063-a03a-3d75b1b1a27d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.726804 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f2529d2-b314-4063-a03a-3d75b1b1a27d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:04.727503 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f2529d2-b314-4063-a03a-3d75b1b1a27d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:04.727958 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f2529d2-b314-4063-a03a-3d75b1b1a27d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:04.728388 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f2529d2-b314-4063-a03a-3d75b1b1a27d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:04.874243 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1f2529d2-b314-4063-a03a-3d75b1b1a27d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:04.878035 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1f2529d2-b314-4063-a03a-3d75b1b1a27d tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1452 microversion: 2.1 time: 0.163508 Sep 01 14:11:04.878613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 599/1197] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:04 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:05.255869 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-303d28a6-63c1-4773-8ea8-15e77dbd3827 req-4ae990e3-ff20-49fe-a74b-393ee78926f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834ae1e8-c5d7-4e0e-9ed5-de94869ba807", "name": "network-vif-plugged", "status": "completed", "tag": "04ae95a5-da52-4220-980e-b647627fc3f9"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:05.265465 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-303d28a6-63c1-4773-8ea8-15e77dbd3827 req-4ae990e3-ff20-49fe-a74b-393ee78926f0 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:05.266072 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-303d28a6-63c1-4773-8ea8-15e77dbd3827 req-4ae990e3-ff20-49fe-a74b-393ee78926f0 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:05.266566 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-303d28a6-63c1-4773-8ea8-15e77dbd3827 req-4ae990e3-ff20-49fe-a74b-393ee78926f0 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:05.279084 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-303d28a6-63c1-4773-8ea8-15e77dbd3827 req-4ae990e3-ff20-49fe-a74b-393ee78926f0 service nova] Creating event network-vif-plugged:04ae95a5-da52-4220-980e-b647627fc3f9 for instance 834ae1e8-c5d7-4e0e-9ed5-de94869ba807 on hv-cinder-85221 Sep 01 14:11:05.287392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-303d28a6-63c1-4773-8ea8-15e77dbd3827 req-4ae990e3-ff20-49fe-a74b-393ee78926f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033301 Sep 01 14:11:05.287392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 599/1198] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:05.448861 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-452c897a-8fca-43d2-b683-15b35e93d042 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:05.449479 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-452c897a-8fca-43d2-b683-15b35e93d042 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:05.456641 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-452c897a-8fca-43d2-b683-15b35e93d042 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:05.457134 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-452c897a-8fca-43d2-b683-15b35e93d042 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:05.457576 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-452c897a-8fca-43d2-b683-15b35e93d042 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:05.458304 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-452c897a-8fca-43d2-b683-15b35e93d042 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:05.458817 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-452c897a-8fca-43d2-b683-15b35e93d042 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:05.459244 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-452c897a-8fca-43d2-b683-15b35e93d042 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:05.615919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-452c897a-8fca-43d2-b683-15b35e93d042 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:05.623779 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-452c897a-8fca-43d2-b683-15b35e93d042 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.178813 Sep 01 14:11:05.624451 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 600/1199] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:05 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:06.645417 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-82c06c45-24db-4178-a3b6-bb16f67be255 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:06.646334 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-82c06c45-24db-4178-a3b6-bb16f67be255 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:06.648675 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 14:11:06.648807 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Thu Sep 1 14:11:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 (ip 10.222.0.61) !!! Sep 01 14:11:06.660660 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-82c06c45-24db-4178-a3b6-bb16f67be255 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:06.661136 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-82c06c45-24db-4178-a3b6-bb16f67be255 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:06.661576 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-82c06c45-24db-4178-a3b6-bb16f67be255 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:06.662316 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-82c06c45-24db-4178-a3b6-bb16f67be255 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:06.662776 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-82c06c45-24db-4178-a3b6-bb16f67be255 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:06.663204 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-82c06c45-24db-4178-a3b6-bb16f67be255 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:06.829853 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-82c06c45-24db-4178-a3b6-bb16f67be255 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:06.836458 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-82c06c45-24db-4178-a3b6-bb16f67be255 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1319 microversion: 2.1 time: 0.194887 Sep 01 14:11:06.837576 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 600/1200] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:06 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:07.056017 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-27f2a7c3-9264-49ab-8ea1-7e24bba8e7a3 req-93a6d041-bd4a-470f-8495-0171bb854f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5", "tag": "50ff7b68-2816-4b8c-af71-8044a278e226"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:07.067422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-27f2a7c3-9264-49ab-8ea1-7e24bba8e7a3 req-93a6d041-bd4a-470f-8495-0171bb854f77 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:07.068162 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-27f2a7c3-9264-49ab-8ea1-7e24bba8e7a3 req-93a6d041-bd4a-470f-8495-0171bb854f77 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:07.068761 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-27f2a7c3-9264-49ab-8ea1-7e24bba8e7a3 req-93a6d041-bd4a-470f-8495-0171bb854f77 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:07.082182 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-27f2a7c3-9264-49ab-8ea1-7e24bba8e7a3 req-93a6d041-bd4a-470f-8495-0171bb854f77 service nova] Creating event network-changed:50ff7b68-2816-4b8c-af71-8044a278e226 for instance 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 on hv-cinder-85221 Sep 01 14:11:07.088118 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-27f2a7c3-9264-49ab-8ea1-7e24bba8e7a3 req-93a6d041-bd4a-470f-8495-0171bb854f77 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035854 Sep 01 14:11:07.088902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 601/1201] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:07.857691 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b20d9456-ae83-4031-a32a-07e6952ac784 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:07.858345 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b20d9456-ae83-4031-a32a-07e6952ac784 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:07.872242 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b20d9456-ae83-4031-a32a-07e6952ac784 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:07.872741 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b20d9456-ae83-4031-a32a-07e6952ac784 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:07.873214 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b20d9456-ae83-4031-a32a-07e6952ac784 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:07.874047 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b20d9456-ae83-4031-a32a-07e6952ac784 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:07.874510 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b20d9456-ae83-4031-a32a-07e6952ac784 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:07.874937 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b20d9456-ae83-4031-a32a-07e6952ac784 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:08.014944 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-b20d9456-ae83-4031-a32a-07e6952ac784 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:08.022881 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b20d9456-ae83-4031-a32a-07e6952ac784 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1508 microversion: 2.1 time: 0.169029 Sep 01 14:11:08.023554 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 601/1202] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:07 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:08.046190 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9748ac30-4688-4e59-a83a-c71ef6b5b8ab tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09bcfd80-79ef-4e63-9ac4-e4e8eb79ff14", "device": "/dev/sdb"}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:08.049495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9748ac30-4688-4e59-a83a-c71ef6b5b8ab tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:08.056550 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9748ac30-4688-4e59-a83a-c71ef6b5b8ab tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:08.057210 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9748ac30-4688-4e59-a83a-c71ef6b5b8ab tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:08.057464 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9748ac30-4688-4e59-a83a-c71ef6b5b8ab tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:08.058225 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9748ac30-4688-4e59-a83a-c71ef6b5b8ab tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:08.058684 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9748ac30-4688-4e59-a83a-c71ef6b5b8ab tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:08.059114 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9748ac30-4688-4e59-a83a-c71ef6b5b8ab tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:08.063362 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=100 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:09.168293 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9748ac30-4688-4e59-a83a-c71ef6b5b8ab tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "POST /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.127363 Sep 01 14:11:09.169038 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 602/1203] 10.222.0.61 () {60 vars in 1323 bytes} [Thu Sep 1 14:11:08 2022] POST /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807/os-volume_attachments => generated 194 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:11:25.539641 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=11 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:25.539641 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=63 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:25.714205 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c6cceb17-c71f-4707-a3b4-aac10efe2063 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Action: 'create', calling method: .version_select at 0x7f1afd575b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1625002278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNtSaKkFHIqxj3EWObYOpJdHNj6mL0ct28MwxR1u1c5yqXXkJWmik53kxO4h2rES62HkWXlCX0Zq08XA4zc0n5tcN+HiY0E2Kdg0ohVb8m/yPlKpuaL0uAXbqlHxOzNVg=="}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:25.730379 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-c6cceb17-c71f-4707-a3b4-aac10efe2063 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Getting quotas for project fb745d3f3bcb44ae9fe9cf80ce054456. Resources: {'key_pairs'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:11:25.734213 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.quota [None req-c6cceb17-c71f-4707-a3b4-aac10efe2063 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Getting quotas for user 3b605f7c7e2e44ccaf652fabbbf4080a and project fb745d3f3bcb44ae9fe9cf80ce054456. Resources: {'key_pairs'} {{(pid=127812) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:11:25.873864 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c6cceb17-c71f-4707-a3b4-aac10efe2063 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.340976 Sep 01 14:11:25.874644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 602/1204] 10.222.0.61 () {60 vars in 1159 bytes} [Thu Sep 1 14:11:25 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:30.968896 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-acd63623-c00e-44bf-b740-2b5d0538a8af tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:30.969476 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-acd63623-c00e-44bf-b740-2b5d0538a8af tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:30.972813 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=31 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:30.973540 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:30.978799 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-acd63623-c00e-44bf-b740-2b5d0538a8af tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:30.979285 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-acd63623-c00e-44bf-b740-2b5d0538a8af tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:30.979720 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-acd63623-c00e-44bf-b740-2b5d0538a8af tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:30.981170 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-acd63623-c00e-44bf-b740-2b5d0538a8af tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:30.981170 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-acd63623-c00e-44bf-b740-2b5d0538a8af tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:30.981412 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-acd63623-c00e-44bf-b740-2b5d0538a8af tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:31.075669 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-acd63623-c00e-44bf-b740-2b5d0538a8af tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lazy-loading 'services' on Instance uuid 834ae1e8-c5d7-4e0e-9ed5-de94869ba807 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:11:31.540691 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-acd63623-c00e-44bf-b740-2b5d0538a8af tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "DELETE /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807/os-volume_attachments/09bcfd80-79ef-4e63-9ac4-e4e8eb79ff14" status: 202 len: 0 microversion: 2.1 time: 0.575925 Sep 01 14:11:31.541291 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 603/1205] 10.222.0.61 () {58 vars in 1416 bytes} [Thu Sep 1 14:11:30 2022] DELETE /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807/os-volume_attachments/09bcfd80-79ef-4e63-9ac4-e4e8eb79ff14 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:11:33.729319 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-b18eb9c1-0511-4b8a-b2e0-a5acc3263646 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:33.729908 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b18eb9c1-0511-4b8a-b2e0-a5acc3263646 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:33.735959 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b18eb9c1-0511-4b8a-b2e0-a5acc3263646 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:33.736444 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b18eb9c1-0511-4b8a-b2e0-a5acc3263646 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:33.736880 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b18eb9c1-0511-4b8a-b2e0-a5acc3263646 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:33.738233 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b18eb9c1-0511-4b8a-b2e0-a5acc3263646 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:33.738690 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b18eb9c1-0511-4b8a-b2e0-a5acc3263646 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:33.739115 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-b18eb9c1-0511-4b8a-b2e0-a5acc3263646 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:33.767707 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-b18eb9c1-0511-4b8a-b2e0-a5acc3263646 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Going to try to terminate instance {{(pid=127812) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:11:34.169351 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-b18eb9c1-0511-4b8a-b2e0-a5acc3263646 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "DELETE /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 204 len: 0 microversion: 2.1 time: 0.445769 Sep 01 14:11:34.169969 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 603/1206] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:11:33 2022] DELETE /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:11:34.179605 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3e5e8899-5a04-4999-9163-dc4fc5f80824 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:34.180301 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3e5e8899-5a04-4999-9163-dc4fc5f80824 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:34.186594 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3e5e8899-5a04-4999-9163-dc4fc5f80824 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:34.187074 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3e5e8899-5a04-4999-9163-dc4fc5f80824 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:34.187509 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3e5e8899-5a04-4999-9163-dc4fc5f80824 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:34.188196 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3e5e8899-5a04-4999-9163-dc4fc5f80824 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:34.188642 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3e5e8899-5a04-4999-9163-dc4fc5f80824 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:34.189060 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3e5e8899-5a04-4999-9163-dc4fc5f80824 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:34.333985 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3e5e8899-5a04-4999-9163-dc4fc5f80824 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:34.341991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3e5e8899-5a04-4999-9163-dc4fc5f80824 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1514 microversion: 2.1 time: 0.167116 Sep 01 14:11:34.342567 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 604/1207] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:34 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:35.363836 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-10eb508d-cde8-4080-acf9-d505c1ce338b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:35.364520 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-10eb508d-cde8-4080-acf9-d505c1ce338b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:35.370877 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10eb508d-cde8-4080-acf9-d505c1ce338b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:35.371362 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10eb508d-cde8-4080-acf9-d505c1ce338b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:35.371793 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10eb508d-cde8-4080-acf9-d505c1ce338b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:35.372542 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10eb508d-cde8-4080-acf9-d505c1ce338b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:35.372990 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10eb508d-cde8-4080-acf9-d505c1ce338b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:35.373408 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-10eb508d-cde8-4080-acf9-d505c1ce338b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:35.533955 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-10eb508d-cde8-4080-acf9-d505c1ce338b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:35.542824 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-10eb508d-cde8-4080-acf9-d505c1ce338b tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1514 microversion: 2.1 time: 0.183275 Sep 01 14:11:35.543422 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 604/1208] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:35 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1514 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:36.564763 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3787ee64-fc5b-4bf9-b65e-b148a6b35521 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:36.565331 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3787ee64-fc5b-4bf9-b65e-b148a6b35521 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:36.571927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3787ee64-fc5b-4bf9-b65e-b148a6b35521 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:36.572422 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3787ee64-fc5b-4bf9-b65e-b148a6b35521 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:36.572863 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3787ee64-fc5b-4bf9-b65e-b148a6b35521 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:36.573577 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3787ee64-fc5b-4bf9-b65e-b148a6b35521 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:36.574137 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3787ee64-fc5b-4bf9-b65e-b148a6b35521 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:36.574571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3787ee64-fc5b-4bf9-b65e-b148a6b35521 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:36.783748 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3787ee64-fc5b-4bf9-b65e-b148a6b35521 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:36.793391 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3787ee64-fc5b-4bf9-b65e-b148a6b35521 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1514 microversion: 2.1 time: 0.232586 Sep 01 14:11:36.794009 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 605/1209] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:36 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:37.112173 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=4 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:37.169388 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-9b902c72-cf18-4e59-905d-5087e8c0a162 req-6923faa4-0a8c-4800-a32e-530457d7f0c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "834ae1e8-c5d7-4e0e-9ed5-de94869ba807", "name": "network-vif-deleted", "tag": "04ae95a5-da52-4220-980e-b647627fc3f9"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:37.182824 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-9b902c72-cf18-4e59-905d-5087e8c0a162 req-6923faa4-0a8c-4800-a32e-530457d7f0c1 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:37.188182 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-9b902c72-cf18-4e59-905d-5087e8c0a162 req-6923faa4-0a8c-4800-a32e-530457d7f0c1 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:37.188182 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-9b902c72-cf18-4e59-905d-5087e8c0a162 req-6923faa4-0a8c-4800-a32e-530457d7f0c1 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:37.196346 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-9b902c72-cf18-4e59-905d-5087e8c0a162 req-6923faa4-0a8c-4800-a32e-530457d7f0c1 service nova] Creating event network-vif-deleted:04ae95a5-da52-4220-980e-b647627fc3f9 for instance 834ae1e8-c5d7-4e0e-9ed5-de94869ba807 on hv-cinder-85221 Sep 01 14:11:37.201599 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-9b902c72-cf18-4e59-905d-5087e8c0a162 req-6923faa4-0a8c-4800-a32e-530457d7f0c1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093729 Sep 01 14:11:37.202228 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 605/1210] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:11:37.814713 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:37.815958 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:37.822566 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:37.822855 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:37.823288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:37.823981 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:37.824425 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:37.824849 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:37.858432 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:37.858928 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:37.859406 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:37.859862 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lazy-loading 'fault' on Instance uuid 834ae1e8-c5d7-4e0e-9ed5-de94869ba807 {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:11:37.906373 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35383b224a5a46de87c41b49fe1bd037', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '035b87bdd94646d0aed7727e587ab40f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:37.915238 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4082dfbc-ef14-412c-ac36-1ad43be1be1e tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 200 len: 1309 microversion: 2.1 time: 0.104293 Sep 01 14:11:37.915968 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 606/1211] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:37 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:38.937502 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-737a18b0-8ad5-4e52-b1c3-ef1f093c7f62 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:38.938175 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-737a18b0-8ad5-4e52-b1c3-ef1f093c7f62 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] [instance: 834ae1e8-c5d7-4e0e-9ed5-de94869ba807] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:38.945516 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-737a18b0-8ad5-4e52-b1c3-ef1f093c7f62 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:38.946012 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-737a18b0-8ad5-4e52-b1c3-ef1f093c7f62 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:38.946455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-737a18b0-8ad5-4e52-b1c3-ef1f093c7f62 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:38.947151 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-737a18b0-8ad5-4e52-b1c3-ef1f093c7f62 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:38.947609 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-737a18b0-8ad5-4e52-b1c3-ef1f093c7f62 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:38.948038 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-737a18b0-8ad5-4e52-b1c3-ef1f093c7f62 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:38.964424 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-737a18b0-8ad5-4e52-b1c3-ef1f093c7f62 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] HTTP exception thrown: Instance 834ae1e8-c5d7-4e0e-9ed5-de94869ba807 could not be found. Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-737a18b0-8ad5-4e52-b1c3-ef1f093c7f62 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Request method failure captured: Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 HTTP/1.1 Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjEL0Ge7opJzzNEobDQ3ina6AAjtpSE6vdkcapE8pfH4yKs1x5IOfK3P_w_nBT1DTTp3QSpzalIe5tHiYFc9Tpj1nSB_xflMY0kaQBhU_gWSErncRAxtFvzeEgYSH8b9dS6EB0G0q5e2zfXDhluJVaF7-wfwEiLggVmqECW8fA2LVG0y4 Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 035b87bdd94646d0aed7727e587ab40f Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-VolumesSnapshotTestJSON-840298032 Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:11:38.966128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:11:38.967919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/035b87bdd94646d0aed7727e587ab40f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/035b87bdd94646d0aed7727e587ab40f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/035b87bdd94646d0aed7727e587ab40f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_035b87bdd94646d0aed7727e587ab40f"}]}] Sep 01 14:11:38.967919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-VolumesSnapshotTestJSON-840298032 Sep 01 14:11:38.967919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 035b87bdd94646d0aed7727e587ab40f Sep 01 14:11:38.967919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-840298032 Sep 01 14:11:38.967919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-VolumesSnapshotTestJSON-840298032-project Sep 01 14:11:38.967919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:11:38.967919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:11:38.967919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 35383b224a5a46de87c41b49fe1bd037 Sep 01 14:11:38.967919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-VolumesSnapshotTestJSON-840298032-project Sep 01 14:11:38.967919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:11:38.967919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 834ae1e8-c5d7-4e0e-9ed5-de94869ba807 could not be found. Sep 01 14:11:38.967919 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '834ae1e8-c5d7-4e0e-9ed5-de94869ba807'} Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 834ae1e8-c5d7-4e0e-9ed5-de94869ba807 could not be found. Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:11:38.968894 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 834ae1e8-c5d7-4e0e-9ed5-de94869ba807 could not be found. Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 834ae1e8-c5d7-4e0e-9ed5-de94869ba807 could not be found. Sep 01 14:11:38.970359 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:11:38.971725 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-737a18b0-8ad5-4e52-b1c3-ef1f093c7f62 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] Returning 404 to user: Instance 834ae1e8-c5d7-4e0e-9ed5-de94869ba807 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:11:38.971725 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-737a18b0-8ad5-4e52-b1c3-ef1f093c7f62 tempest-VolumesSnapshotTestJSON-840298032 tempest-VolumesSnapshotTestJSON-840298032-project] 10.222.0.61 "GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807" status: 404 len: 111 microversion: 2.1 time: 0.034837 Sep 01 14:11:38.971725 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 606/1212] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:38 2022] GET /compute/v2.1/servers/834ae1e8-c5d7-4e0e-9ed5-de94869ba807 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:11:50.478775 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-637337090", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1625002278", "security_groups": [{"name": "tempest-secgroup-smoke-16410023"}], "networks": [{"uuid": "37020965-3910-4ac4-87d4-5ad5d9dd2d4d"}], "block_device_mapping_v2": [{"uuid": "2c3fa7ca-1d36-4e27-96d6-4ef5f8465994", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:50.490420 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=10 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:50.491116 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:50.595851 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.network.neutron [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] validate_networks() for [('37020965-3910-4ac4-87d4-5ad5d9dd2d4d', None, None, None, None, None)] {{(pid=127811) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 14:11:51.084364 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Flavor limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 14:11:51.084792 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Image limits 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 14:11:51.085310 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Flavor pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 14:11:51.085750 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Image pref 0:0:0 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 14:11:51.086404 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.virt.hardware [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 14:11:51.096822 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:51.097313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:51.097866 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:51.098613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:51.099065 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:51.099495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:51.117732 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Getting quotas for project fb745d3f3bcb44ae9fe9cf80ce054456. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 14:11:51.122321 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.quota [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Getting quotas for user 3b605f7c7e2e44ccaf652fabbbf4080a and project fb745d3f3bcb44ae9fe9cf80ce054456. Resources: {'cores', 'instances', 'ram'} {{(pid=127811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 14:11:51.183901 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Going to run 1 instances... {{(pid=127811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 14:11:51.186123 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c3fa7ca-1d36-4e27-96d6-4ef5f8465994',volume_size=None,volume_type=None)] {{(pid=127811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 14:11:51.846043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7e424f3d-2191-4828-a254-79db1f0e144a tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.371137 Sep 01 14:11:51.846846 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 607/1213] 10.222.0.61 () {60 vars in 1147 bytes} [Thu Sep 1 14:11:50 2022] POST /compute/v2.1/servers => generated 404 bytes in 1373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 14:11:51.859484 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-51221e36-a0c4-41d9-945f-50aa1db1d8b2 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:51.860511 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-51221e36-a0c4-41d9-945f-50aa1db1d8b2 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:51.865146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:51.865954 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:11:51.941538 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-51221e36-a0c4-41d9-945f-50aa1db1d8b2 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:51.948455 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-51221e36-a0c4-41d9-945f-50aa1db1d8b2 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1088 microversion: 2.1 time: 0.092999 Sep 01 14:11:51.949158 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 607/1214] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:51 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1088 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:52.972623 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a7af7af7-5b6f-4560-83c8-ae0b50fae7ad tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:52.972623 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a7af7af7-5b6f-4560-83c8-ae0b50fae7ad tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:53.027697 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-a7af7af7-5b6f-4560-83c8-ae0b50fae7ad tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:53.034583 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a7af7af7-5b6f-4560-83c8-ae0b50fae7ad tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1088 microversion: 2.1 time: 0.068786 Sep 01 14:11:53.035138 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 608/1215] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:52 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:11:54.056151 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-84709e45-18d6-4d2d-8d2a-1754d8a796da tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:54.056754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-84709e45-18d6-4d2d-8d2a-1754d8a796da tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:54.064949 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-84709e45-18d6-4d2d-8d2a-1754d8a796da tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:54.065436 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-84709e45-18d6-4d2d-8d2a-1754d8a796da tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:54.065908 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-84709e45-18d6-4d2d-8d2a-1754d8a796da tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:54.066607 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-84709e45-18d6-4d2d-8d2a-1754d8a796da tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:54.067063 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-84709e45-18d6-4d2d-8d2a-1754d8a796da tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:54.067493 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-84709e45-18d6-4d2d-8d2a-1754d8a796da tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:54.127862 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-84709e45-18d6-4d2d-8d2a-1754d8a796da tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:54.136076 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-84709e45-18d6-4d2d-8d2a-1754d8a796da tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1138 microversion: 2.1 time: 0.084456 Sep 01 14:11:54.136628 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 608/1216] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:54 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:55.156224 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-0cc4bb9d-4fa0-437b-8caf-9b06195c1737 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:55.156824 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-0cc4bb9d-4fa0-437b-8caf-9b06195c1737 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:55.164272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0cc4bb9d-4fa0-437b-8caf-9b06195c1737 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:55.164752 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0cc4bb9d-4fa0-437b-8caf-9b06195c1737 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:55.165185 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0cc4bb9d-4fa0-437b-8caf-9b06195c1737 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:55.165957 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0cc4bb9d-4fa0-437b-8caf-9b06195c1737 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:55.166423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0cc4bb9d-4fa0-437b-8caf-9b06195c1737 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:55.166832 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-0cc4bb9d-4fa0-437b-8caf-9b06195c1737 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:55.228869 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-0cc4bb9d-4fa0-437b-8caf-9b06195c1737 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:55.236443 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-0cc4bb9d-4fa0-437b-8caf-9b06195c1737 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1138 microversion: 2.1 time: 0.084027 Sep 01 14:11:55.237647 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 609/1217] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:55 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:56.264814 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4db09bf4-ac63-48e1-a9eb-73f65cbcea45 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:56.265419 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4db09bf4-ac63-48e1-a9eb-73f65cbcea45 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:56.271893 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4db09bf4-ac63-48e1-a9eb-73f65cbcea45 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:56.272438 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4db09bf4-ac63-48e1-a9eb-73f65cbcea45 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:56.272887 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4db09bf4-ac63-48e1-a9eb-73f65cbcea45 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:56.273632 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4db09bf4-ac63-48e1-a9eb-73f65cbcea45 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:56.274117 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4db09bf4-ac63-48e1-a9eb-73f65cbcea45 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:56.277673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4db09bf4-ac63-48e1-a9eb-73f65cbcea45 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:56.338849 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4db09bf4-ac63-48e1-a9eb-73f65cbcea45 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:56.346885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4db09bf4-ac63-48e1-a9eb-73f65cbcea45 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1186 microversion: 2.1 time: 0.086386 Sep 01 14:11:56.347458 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 609/1218] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:56 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:57.367437 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-08fbc395-0dfb-4d07-8d5a-44c1d754c010 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:57.368220 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-08fbc395-0dfb-4d07-8d5a-44c1d754c010 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:57.375061 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08fbc395-0dfb-4d07-8d5a-44c1d754c010 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:57.375559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08fbc395-0dfb-4d07-8d5a-44c1d754c010 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:57.376024 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08fbc395-0dfb-4d07-8d5a-44c1d754c010 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:57.376731 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08fbc395-0dfb-4d07-8d5a-44c1d754c010 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:57.377186 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08fbc395-0dfb-4d07-8d5a-44c1d754c010 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:57.377615 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-08fbc395-0dfb-4d07-8d5a-44c1d754c010 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:57.464261 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-08fbc395-0dfb-4d07-8d5a-44c1d754c010 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:57.472402 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-08fbc395-0dfb-4d07-8d5a-44c1d754c010 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1204 microversion: 2.1 time: 0.108750 Sep 01 14:11:57.473273 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 610/1219] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:57 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1204 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:58.495343 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5a7c4cef-72bd-47f6-bc1f-12e3b034ef37 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:58.496080 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5a7c4cef-72bd-47f6-bc1f-12e3b034ef37 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:58.502807 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a7c4cef-72bd-47f6-bc1f-12e3b034ef37 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:58.503326 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a7c4cef-72bd-47f6-bc1f-12e3b034ef37 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:58.503794 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a7c4cef-72bd-47f6-bc1f-12e3b034ef37 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:58.504479 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a7c4cef-72bd-47f6-bc1f-12e3b034ef37 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:58.504940 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a7c4cef-72bd-47f6-bc1f-12e3b034ef37 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:58.505370 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5a7c4cef-72bd-47f6-bc1f-12e3b034ef37 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:58.701459 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5a7c4cef-72bd-47f6-bc1f-12e3b034ef37 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:58.709837 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5a7c4cef-72bd-47f6-bc1f-12e3b034ef37 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1270 microversion: 2.1 time: 0.218942 Sep 01 14:11:58.710411 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 610/1220] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:58 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1270 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:11:58.935426 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-f1816194-bb62-4977-8d7c-7080972bcc40 req-41be6cbc-5dd9-443e-8408-e2dab746db84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc01db73-68ab-4fc1-b642-2967c555e129", "tag": "3eee6459-74c7-445e-9787-dc0ed094ff8f"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:11:58.946666 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f1816194-bb62-4977-8d7c-7080972bcc40 req-41be6cbc-5dd9-443e-8408-e2dab746db84 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:58.957514 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f1816194-bb62-4977-8d7c-7080972bcc40 req-41be6cbc-5dd9-443e-8408-e2dab746db84 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:58.957514 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-f1816194-bb62-4977-8d7c-7080972bcc40 req-41be6cbc-5dd9-443e-8408-e2dab746db84 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:58.959846 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-f1816194-bb62-4977-8d7c-7080972bcc40 req-41be6cbc-5dd9-443e-8408-e2dab746db84 service nova] Creating event network-changed:3eee6459-74c7-445e-9787-dc0ed094ff8f for instance bc01db73-68ab-4fc1-b642-2967c555e129 on hv-cinder-85221 Sep 01 14:11:58.964666 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-f1816194-bb62-4977-8d7c-7080972bcc40 req-41be6cbc-5dd9-443e-8408-e2dab746db84 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033085 Sep 01 14:11:58.965634 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 611/1221] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:11:59.730674 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-69c95ced-fcf4-4ddf-af1e-9dedcaa4223e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:11:59.731288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-69c95ced-fcf4-4ddf-af1e-9dedcaa4223e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:11:59.738471 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-69c95ced-fcf4-4ddf-af1e-9dedcaa4223e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:59.738957 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-69c95ced-fcf4-4ddf-af1e-9dedcaa4223e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:59.739389 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-69c95ced-fcf4-4ddf-af1e-9dedcaa4223e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:59.740097 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-69c95ced-fcf4-4ddf-af1e-9dedcaa4223e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:11:59.740547 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-69c95ced-fcf4-4ddf-af1e-9dedcaa4223e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:11:59.740971 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-69c95ced-fcf4-4ddf-af1e-9dedcaa4223e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:11:59.894356 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-69c95ced-fcf4-4ddf-af1e-9dedcaa4223e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:11:59.902631 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-69c95ced-fcf4-4ddf-af1e-9dedcaa4223e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1258 microversion: 2.1 time: 0.175847 Sep 01 14:11:59.903245 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 611/1222] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:11:59 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:00.925383 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9d7dd4a7-9d07-4bd1-a0ac-dbdc554f7bff tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:00.926137 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9d7dd4a7-9d07-4bd1-a0ac-dbdc554f7bff tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:00.932423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9d7dd4a7-9d07-4bd1-a0ac-dbdc554f7bff tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:00.932907 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9d7dd4a7-9d07-4bd1-a0ac-dbdc554f7bff tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:00.933345 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9d7dd4a7-9d07-4bd1-a0ac-dbdc554f7bff tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:00.934069 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9d7dd4a7-9d07-4bd1-a0ac-dbdc554f7bff tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:00.934534 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9d7dd4a7-9d07-4bd1-a0ac-dbdc554f7bff tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:00.934982 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9d7dd4a7-9d07-4bd1-a0ac-dbdc554f7bff tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:01.107057 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=2 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:01.336179 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9d7dd4a7-9d07-4bd1-a0ac-dbdc554f7bff tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:01.344285 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9d7dd4a7-9d07-4bd1-a0ac-dbdc554f7bff tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1258 microversion: 2.1 time: 0.423769 Sep 01 14:12:01.344847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 612/1223] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:00 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1258 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:02.364785 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-71108b5c-be0f-4bf1-bc6d-1fcc5748ff78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:02.365393 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-71108b5c-be0f-4bf1-bc6d-1fcc5748ff78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:02.367840 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell0:SELECT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:02.372678 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-71108b5c-be0f-4bf1-bc6d-1fcc5748ff78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:02.373157 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-71108b5c-be0f-4bf1-bc6d-1fcc5748ff78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:02.373587 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-71108b5c-be0f-4bf1-bc6d-1fcc5748ff78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:02.374328 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-71108b5c-be0f-4bf1-bc6d-1fcc5748ff78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:02.374777 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-71108b5c-be0f-4bf1-bc6d-1fcc5748ff78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:02.375247 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-71108b5c-be0f-4bf1-bc6d-1fcc5748ff78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:02.510965 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-71108b5c-be0f-4bf1-bc6d-1fcc5748ff78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:02.519675 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-71108b5c-be0f-4bf1-bc6d-1fcc5748ff78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1258 microversion: 2.1 time: 0.158778 Sep 01 14:12:02.520481 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 612/1224] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:02 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:03.540834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-988462ba-a0b4-4516-b22e-d62296636772 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:03.541463 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-988462ba-a0b4-4516-b22e-d62296636772 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:03.543738 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell0:SELECT=8 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:03.548459 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-988462ba-a0b4-4516-b22e-d62296636772 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:03.548984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-988462ba-a0b4-4516-b22e-d62296636772 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:03.549452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-988462ba-a0b4-4516-b22e-d62296636772 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:03.550758 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-988462ba-a0b4-4516-b22e-d62296636772 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:03.551212 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-988462ba-a0b4-4516-b22e-d62296636772 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:03.551631 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-988462ba-a0b4-4516-b22e-d62296636772 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:03.685913 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-988462ba-a0b4-4516-b22e-d62296636772 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:03.693650 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-988462ba-a0b4-4516-b22e-d62296636772 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1258 microversion: 2.1 time: 0.156700 Sep 01 14:12:03.694255 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 613/1225] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:03 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:04.714141 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-e50b1f23-a075-4322-9c60-4ab283738c56 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:04.714747 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-e50b1f23-a075-4322-9c60-4ab283738c56 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:04.721249 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e50b1f23-a075-4322-9c60-4ab283738c56 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:04.723801 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e50b1f23-a075-4322-9c60-4ab283738c56 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:04.723801 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e50b1f23-a075-4322-9c60-4ab283738c56 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:04.723801 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e50b1f23-a075-4322-9c60-4ab283738c56 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:04.723801 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e50b1f23-a075-4322-9c60-4ab283738c56 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:04.724236 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-e50b1f23-a075-4322-9c60-4ab283738c56 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:04.856786 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-e50b1f23-a075-4322-9c60-4ab283738c56 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:04.866347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-e50b1f23-a075-4322-9c60-4ab283738c56 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1258 microversion: 2.1 time: 0.156093 Sep 01 14:12:04.866931 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 613/1226] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:04 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:05.887219 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-f5159e19-fe43-4937-a280-a12d7e305eec tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:05.887815 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-f5159e19-fe43-4937-a280-a12d7e305eec tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:05.895538 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f5159e19-fe43-4937-a280-a12d7e305eec tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:05.896020 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f5159e19-fe43-4937-a280-a12d7e305eec tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:05.896452 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f5159e19-fe43-4937-a280-a12d7e305eec tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:05.897136 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f5159e19-fe43-4937-a280-a12d7e305eec tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:05.897583 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f5159e19-fe43-4937-a280-a12d7e305eec tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:05.898030 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-f5159e19-fe43-4937-a280-a12d7e305eec tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:06.028487 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-f5159e19-fe43-4937-a280-a12d7e305eec tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:06.036279 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-f5159e19-fe43-4937-a280-a12d7e305eec tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1258 microversion: 2.1 time: 0.152940 Sep 01 14:12:06.036834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 614/1227] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:05 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:07.056324 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-57089284-bb2b-4656-8d0f-f2dda4be2051 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:07.056958 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-57089284-bb2b-4656-8d0f-f2dda4be2051 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:07.063102 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57089284-bb2b-4656-8d0f-f2dda4be2051 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:07.065712 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57089284-bb2b-4656-8d0f-f2dda4be2051 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:07.065712 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57089284-bb2b-4656-8d0f-f2dda4be2051 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:07.065712 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57089284-bb2b-4656-8d0f-f2dda4be2051 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:07.065712 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57089284-bb2b-4656-8d0f-f2dda4be2051 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:07.066141 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-57089284-bb2b-4656-8d0f-f2dda4be2051 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:07.218857 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-57089284-bb2b-4656-8d0f-f2dda4be2051 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:07.224949 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-57089284-bb2b-4656-8d0f-f2dda4be2051 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1258 microversion: 2.1 time: 0.172526 Sep 01 14:12:07.225519 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 614/1228] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:07 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:08.246847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9fe4aa0b-02e6-461d-90b8-75ea524e3dbb tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:08.247392 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9fe4aa0b-02e6-461d-90b8-75ea524e3dbb tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:08.254902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9fe4aa0b-02e6-461d-90b8-75ea524e3dbb tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:08.255395 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9fe4aa0b-02e6-461d-90b8-75ea524e3dbb tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:08.256076 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9fe4aa0b-02e6-461d-90b8-75ea524e3dbb tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:08.256783 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9fe4aa0b-02e6-461d-90b8-75ea524e3dbb tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:08.257235 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9fe4aa0b-02e6-461d-90b8-75ea524e3dbb tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:08.257657 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9fe4aa0b-02e6-461d-90b8-75ea524e3dbb tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:08.483350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9fe4aa0b-02e6-461d-90b8-75ea524e3dbb tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:08.491511 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9fe4aa0b-02e6-461d-90b8-75ea524e3dbb tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1258 microversion: 2.1 time: 0.248742 Sep 01 14:12:08.492092 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 615/1229] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:08 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1258 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:09.512985 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5b4ce2bf-028a-4f10-befd-9edadd1c771f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:09.513607 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5b4ce2bf-028a-4f10-befd-9edadd1c771f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:09.521100 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b4ce2bf-028a-4f10-befd-9edadd1c771f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:09.521842 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b4ce2bf-028a-4f10-befd-9edadd1c771f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:09.529460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b4ce2bf-028a-4f10-befd-9edadd1c771f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:09.529460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b4ce2bf-028a-4f10-befd-9edadd1c771f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:09.529460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b4ce2bf-028a-4f10-befd-9edadd1c771f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:09.529460 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5b4ce2bf-028a-4f10-befd-9edadd1c771f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:09.708555 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5b4ce2bf-028a-4f10-befd-9edadd1c771f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:09.717274 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5b4ce2bf-028a-4f10-befd-9edadd1c771f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1258 microversion: 2.1 time: 0.208349 Sep 01 14:12:09.718086 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 615/1230] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:09 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1258 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:10.739048 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-14f8aa3b-a8c3-4288-9971-286f69aff807 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:10.739659 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-14f8aa3b-a8c3-4288-9971-286f69aff807 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:10.746730 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-14f8aa3b-a8c3-4288-9971-286f69aff807 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:10.747272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-14f8aa3b-a8c3-4288-9971-286f69aff807 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:10.757208 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-14f8aa3b-a8c3-4288-9971-286f69aff807 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:10.757208 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-14f8aa3b-a8c3-4288-9971-286f69aff807 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:10.757208 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-14f8aa3b-a8c3-4288-9971-286f69aff807 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:10.757208 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-14f8aa3b-a8c3-4288-9971-286f69aff807 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:10.908485 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-14f8aa3b-a8c3-4288-9971-286f69aff807 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:10.916649 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-14f8aa3b-a8c3-4288-9971-286f69aff807 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1258 microversion: 2.1 time: 0.181973 Sep 01 14:12:10.917401 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 616/1231] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:10 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:10.949505 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-040129ed-4ef0-4860-8090-a7427a3566ef req-e1e33149-a29e-4bf6-8989-ba7e24ea3e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc01db73-68ab-4fc1-b642-2967c555e129", "name": "network-vif-plugged", "status": "completed", "tag": "3eee6459-74c7-445e-9787-dc0ed094ff8f"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:10.958149 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-040129ed-4ef0-4860-8090-a7427a3566ef req-e1e33149-a29e-4bf6-8989-ba7e24ea3e28 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:10.958630 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-040129ed-4ef0-4860-8090-a7427a3566ef req-e1e33149-a29e-4bf6-8989-ba7e24ea3e28 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:10.959064 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-040129ed-4ef0-4860-8090-a7427a3566ef req-e1e33149-a29e-4bf6-8989-ba7e24ea3e28 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:10.969972 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-040129ed-4ef0-4860-8090-a7427a3566ef req-e1e33149-a29e-4bf6-8989-ba7e24ea3e28 service nova] Creating event network-vif-plugged:3eee6459-74c7-445e-9787-dc0ed094ff8f for instance bc01db73-68ab-4fc1-b642-2967c555e129 on hv-cinder-85221 Sep 01 14:12:10.974970 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-040129ed-4ef0-4860-8090-a7427a3566ef req-e1e33149-a29e-4bf6-8989-ba7e24ea3e28 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171022 Sep 01 14:12:10.975554 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 616/1232] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:11.936516 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-469656f6-1120-4141-bc03-f69cf7095ce7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:11.937130 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-469656f6-1120-4141-bc03-f69cf7095ce7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:11.943836 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-469656f6-1120-4141-bc03-f69cf7095ce7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:11.944322 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-469656f6-1120-4141-bc03-f69cf7095ce7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:11.944760 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-469656f6-1120-4141-bc03-f69cf7095ce7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:11.945455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-469656f6-1120-4141-bc03-f69cf7095ce7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:11.945977 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-469656f6-1120-4141-bc03-f69cf7095ce7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:11.946409 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-469656f6-1120-4141-bc03-f69cf7095ce7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:12.082327 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-469656f6-1120-4141-bc03-f69cf7095ce7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:12.090272 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-469656f6-1120-4141-bc03-f69cf7095ce7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1258 microversion: 2.1 time: 0.157591 Sep 01 14:12:12.093394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 617/1233] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:11 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:13.114247 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-df59b408-4260-4743-8b42-f8ee7137155e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:13.114964 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-df59b408-4260-4743-8b42-f8ee7137155e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:13.121178 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df59b408-4260-4743-8b42-f8ee7137155e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:13.121754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df59b408-4260-4743-8b42-f8ee7137155e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:13.126878 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df59b408-4260-4743-8b42-f8ee7137155e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:13.126878 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df59b408-4260-4743-8b42-f8ee7137155e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:13.126878 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df59b408-4260-4743-8b42-f8ee7137155e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:13.126878 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-df59b408-4260-4743-8b42-f8ee7137155e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:13.259945 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-df59b408-4260-4743-8b42-f8ee7137155e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:13.267705 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-df59b408-4260-4743-8b42-f8ee7137155e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1442 microversion: 2.1 time: 0.158945 Sep 01 14:12:13.268909 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 617/1234] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:13 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1442 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:13.289973 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d3c2992b-70f2-4cd1-888f-8196086c97d8 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:13.290681 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d3c2992b-70f2-4cd1-888f-8196086c97d8 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:13.297276 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d3c2992b-70f2-4cd1-888f-8196086c97d8 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:13.297845 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d3c2992b-70f2-4cd1-888f-8196086c97d8 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:13.298288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d3c2992b-70f2-4cd1-888f-8196086c97d8 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:13.299018 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d3c2992b-70f2-4cd1-888f-8196086c97d8 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:13.299619 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d3c2992b-70f2-4cd1-888f-8196086c97d8 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:13.300050 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d3c2992b-70f2-4cd1-888f-8196086c97d8 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:13.438509 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d3c2992b-70f2-4cd1-888f-8196086c97d8 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:13.447129 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d3c2992b-70f2-4cd1-888f-8196086c97d8 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1442 microversion: 2.1 time: 0.161514 Sep 01 14:12:13.447846 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 618/1235] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:13 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1442 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:15.715600 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-0ff3895f-c94c-4b88-9e9f-9fca1cb9f3e3 req-a42179ae-8630-43f8-a956-372099957bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc01db73-68ab-4fc1-b642-2967c555e129", "tag": "3eee6459-74c7-445e-9787-dc0ed094ff8f"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:15.725923 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0ff3895f-c94c-4b88-9e9f-9fca1cb9f3e3 req-a42179ae-8630-43f8-a956-372099957bc6 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:15.726398 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0ff3895f-c94c-4b88-9e9f-9fca1cb9f3e3 req-a42179ae-8630-43f8-a956-372099957bc6 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:15.726828 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-0ff3895f-c94c-4b88-9e9f-9fca1cb9f3e3 req-a42179ae-8630-43f8-a956-372099957bc6 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:15.738492 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-0ff3895f-c94c-4b88-9e9f-9fca1cb9f3e3 req-a42179ae-8630-43f8-a956-372099957bc6 service nova] Creating event network-changed:3eee6459-74c7-445e-9787-dc0ed094ff8f for instance bc01db73-68ab-4fc1-b642-2967c555e129 on hv-cinder-85221 Sep 01 14:12:15.743678 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-0ff3895f-c94c-4b88-9e9f-9fca1cb9f3e3 req-a42179ae-8630-43f8-a956-372099957bc6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031743 Sep 01 14:12:15.744297 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 618/1236] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:44.673756 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:44.674916 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=58 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:44.677423 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=26 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:44.678260 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=58 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:12:44.680860 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-a0088640-6f50-4f3c-bd69-53281c088d78 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:44.681360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a0088640-6f50-4f3c-bd69-53281c088d78 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:44.688920 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a0088640-6f50-4f3c-bd69-53281c088d78 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:44.689593 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a0088640-6f50-4f3c-bd69-53281c088d78 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:44.690113 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a0088640-6f50-4f3c-bd69-53281c088d78 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:44.690771 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a0088640-6f50-4f3c-bd69-53281c088d78 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:44.691348 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a0088640-6f50-4f3c-bd69-53281c088d78 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:44.691764 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-a0088640-6f50-4f3c-bd69-53281c088d78 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:44.723859 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-a0088640-6f50-4f3c-bd69-53281c088d78 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Going to try to terminate instance {{(pid=127811) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:12:44.880686 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-3832c960-c1ab-420b-9e02-70bdcf47a9f5 req-1f30b217-7e30-475f-be36-0ebf613675c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5", "tag": "50ff7b68-2816-4b8c-af71-8044a278e226"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:44.890884 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-3832c960-c1ab-420b-9e02-70bdcf47a9f5 req-1f30b217-7e30-475f-be36-0ebf613675c7 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:44.891386 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-3832c960-c1ab-420b-9e02-70bdcf47a9f5 req-1f30b217-7e30-475f-be36-0ebf613675c7 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:44.891825 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-3832c960-c1ab-420b-9e02-70bdcf47a9f5 req-1f30b217-7e30-475f-be36-0ebf613675c7 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:44.904291 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-3832c960-c1ab-420b-9e02-70bdcf47a9f5 req-1f30b217-7e30-475f-be36-0ebf613675c7 service nova] Creating event network-changed:50ff7b68-2816-4b8c-af71-8044a278e226 for instance 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 on hv-cinder-85221 Sep 01 14:12:44.909395 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-3832c960-c1ab-420b-9e02-70bdcf47a9f5 req-1f30b217-7e30-475f-be36-0ebf613675c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.234173 Sep 01 14:12:44.910627 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 619/1237] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:45.101215 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-a0088640-6f50-4f3c-bd69-53281c088d78 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 204 len: 0 microversion: 2.1 time: 0.428317 Sep 01 14:12:45.105312 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 619/1238] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:12:44 2022] DELETE /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 14:12:45.115155 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-32f3cf75-5129-474a-961d-9a674d667ade tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:45.115155 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-32f3cf75-5129-474a-961d-9a674d667ade tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:45.117871 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32f3cf75-5129-474a-961d-9a674d667ade tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:45.118358 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32f3cf75-5129-474a-961d-9a674d667ade tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:45.118795 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32f3cf75-5129-474a-961d-9a674d667ade tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:45.119505 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32f3cf75-5129-474a-961d-9a674d667ade tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:45.120160 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32f3cf75-5129-474a-961d-9a674d667ade tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:45.120588 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32f3cf75-5129-474a-961d-9a674d667ade tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:45.257741 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-32f3cf75-5129-474a-961d-9a674d667ade tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:45.265539 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-32f3cf75-5129-474a-961d-9a674d667ade tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1576 microversion: 2.1 time: 0.158968 Sep 01 14:12:45.266140 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 620/1239] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:45 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:46.288165 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-45679bb3-19ce-459f-8a73-e1bd3c81e654 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:46.288854 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-45679bb3-19ce-459f-8a73-e1bd3c81e654 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:46.295440 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-45679bb3-19ce-459f-8a73-e1bd3c81e654 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:46.295919 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-45679bb3-19ce-459f-8a73-e1bd3c81e654 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:46.296643 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-45679bb3-19ce-459f-8a73-e1bd3c81e654 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:46.297034 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-45679bb3-19ce-459f-8a73-e1bd3c81e654 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:46.297481 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-45679bb3-19ce-459f-8a73-e1bd3c81e654 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:46.297924 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-45679bb3-19ce-459f-8a73-e1bd3c81e654 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:46.444723 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-45679bb3-19ce-459f-8a73-e1bd3c81e654 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:46.452515 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-45679bb3-19ce-459f-8a73-e1bd3c81e654 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1576 microversion: 2.1 time: 0.169070 Sep 01 14:12:46.453149 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 620/1240] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:46 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:47.474240 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-8ad931f6-0842-4979-9b81-1358ac2ee62a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:47.474789 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-8ad931f6-0842-4979-9b81-1358ac2ee62a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:47.481664 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8ad931f6-0842-4979-9b81-1358ac2ee62a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:47.482196 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8ad931f6-0842-4979-9b81-1358ac2ee62a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:47.482630 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8ad931f6-0842-4979-9b81-1358ac2ee62a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:47.483320 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8ad931f6-0842-4979-9b81-1358ac2ee62a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:47.483767 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8ad931f6-0842-4979-9b81-1358ac2ee62a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:47.484189 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-8ad931f6-0842-4979-9b81-1358ac2ee62a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:47.629066 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-8ad931f6-0842-4979-9b81-1358ac2ee62a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:47.637614 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-8ad931f6-0842-4979-9b81-1358ac2ee62a tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1458 microversion: 2.1 time: 0.167430 Sep 01 14:12:47.638270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 621/1241] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:47 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1458 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:47.670167 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-7ec67626-abf3-490b-b309-0367228e7413 req-da828ee0-1de2-48e5-80af-960f0e897817 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5", "name": "network-vif-deleted", "tag": "50ff7b68-2816-4b8c-af71-8044a278e226"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:47.680526 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-7ec67626-abf3-490b-b309-0367228e7413 req-da828ee0-1de2-48e5-80af-960f0e897817 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:47.681037 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-7ec67626-abf3-490b-b309-0367228e7413 req-da828ee0-1de2-48e5-80af-960f0e897817 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:47.681475 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-7ec67626-abf3-490b-b309-0367228e7413 req-da828ee0-1de2-48e5-80af-960f0e897817 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:47.692381 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-7ec67626-abf3-490b-b309-0367228e7413 req-da828ee0-1de2-48e5-80af-960f0e897817 service nova] Creating event network-vif-deleted:50ff7b68-2816-4b8c-af71-8044a278e226 for instance 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 on hv-cinder-85221 Sep 01 14:12:47.697233 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-7ec67626-abf3-490b-b309-0367228e7413 req-da828ee0-1de2-48e5-80af-960f0e897817 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030910 Sep 01 14:12:47.697837 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 621/1242] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:48.658747 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:48.659432 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:48.666263 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:48.666778 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:48.667272 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:48.667943 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:48.668403 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:48.668835 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:48.701128 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:48.701616 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:48.702091 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:48.702590 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lazy-loading 'fault' on Instance uuid 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:12:48.746714 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:48.755754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d0a818a7-afe9-4dc0-a1ca-8ec5d164f4ae tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 200 len: 1231 microversion: 2.1 time: 0.100998 Sep 01 14:12:48.756631 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 622/1243] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:48 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:49.778230 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8279d648-7e93-4472-a7b7-df699bf1b0df tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:49.778917 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-8279d648-7e93-4472-a7b7-df699bf1b0df tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:49.785597 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8279d648-7e93-4472-a7b7-df699bf1b0df tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:49.786091 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8279d648-7e93-4472-a7b7-df699bf1b0df tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:49.786520 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8279d648-7e93-4472-a7b7-df699bf1b0df tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:49.787196 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8279d648-7e93-4472-a7b7-df699bf1b0df tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:49.787644 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8279d648-7e93-4472-a7b7-df699bf1b0df tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:49.788061 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-8279d648-7e93-4472-a7b7-df699bf1b0df tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:49.801019 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-8279d648-7e93-4472-a7b7-df699bf1b0df tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] HTTP exception thrown: Instance 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 could not be found. Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8279d648-7e93-4472-a7b7-df699bf1b0df tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Request method failure captured: Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 HTTP/1.1 Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELwUAd9uZvipXIPvhrAl9M1gbALqYrwCACOdFsg6eEYQQ0SbUtKohFPV4qiStan4YPpxBQ8-doa6Z8WMTQdSfASO9jJuuWAQfy2y5R9s3ElypO0zXeJlLDJrQvJyMORMqWq-1O-uVzpu7bg3dGq5pnRQZTBWxtxdZQrfUPQBsAk0OX0 Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 9086ba5c610d4954a238d6569ec32f0b Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-TestVolumeBootPattern-185563680 Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:12:49.802733 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:12:49.804447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9086ba5c610d4954a238d6569ec32f0b"}]}] Sep 01 14:12:49.804447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-TestVolumeBootPattern-185563680 Sep 01 14:12:49.804447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 9086ba5c610d4954a238d6569ec32f0b Sep 01 14:12:49.804447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-TestVolumeBootPattern-185563680 Sep 01 14:12:49.804447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-TestVolumeBootPattern-185563680-project Sep 01 14:12:49.804447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:12:49.804447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:12:49.804447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 748b8b4771ac498a88fdd98c8a4914ad Sep 01 14:12:49.804447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-TestVolumeBootPattern-185563680-project Sep 01 14:12:49.804447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:12:49.804447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 could not be found. Sep 01 14:12:49.804447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5'} Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 could not be found. Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:12:49.805495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 could not be found. Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 could not be found. Sep 01 14:12:49.807271 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:12:49.808833 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-8279d648-7e93-4472-a7b7-df699bf1b0df tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Returning 404 to user: Instance 7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:12:49.808833 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-8279d648-7e93-4472-a7b7-df699bf1b0df tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5" status: 404 len: 111 microversion: 2.1 time: 0.030698 Sep 01 14:12:49.808833 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 622/1244] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:49 2022] GET /compute/v2.1/servers/7c08b4d5-ae29-4bd2-a65a-e9ad7605e8d5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:12:53.205252 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-badfbd16-8be7-4735-b226-12dd375edc53 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:53.205820 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-badfbd16-8be7-4735-b226-12dd375edc53 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:53.208112 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-3fb8fcd6-3c27-4f58-a6e7-9a58cde27fee req-b68b6097-e67d-4222-9256-84f5f0e0c5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7007a86d-dd1d-45fe-a163-9f3c5118e51b", "tag": "b3883027-3665-4906-802f-0c55de1ef651"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:53.212800 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-badfbd16-8be7-4735-b226-12dd375edc53 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:53.213296 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-badfbd16-8be7-4735-b226-12dd375edc53 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:53.213738 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-badfbd16-8be7-4735-b226-12dd375edc53 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:53.214681 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-badfbd16-8be7-4735-b226-12dd375edc53 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:53.215144 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-badfbd16-8be7-4735-b226-12dd375edc53 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:53.215579 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-badfbd16-8be7-4735-b226-12dd375edc53 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:53.218441 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-3fb8fcd6-3c27-4f58-a6e7-9a58cde27fee req-b68b6097-e67d-4222-9256-84f5f0e0c5c0 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:53.219006 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-3fb8fcd6-3c27-4f58-a6e7-9a58cde27fee req-b68b6097-e67d-4222-9256-84f5f0e0c5c0 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:53.219687 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-3fb8fcd6-3c27-4f58-a6e7-9a58cde27fee req-b68b6097-e67d-4222-9256-84f5f0e0c5c0 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:53.232141 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-3fb8fcd6-3c27-4f58-a6e7-9a58cde27fee req-b68b6097-e67d-4222-9256-84f5f0e0c5c0 service nova] Creating event network-changed:b3883027-3665-4906-802f-0c55de1ef651 for instance 7007a86d-dd1d-45fe-a163-9f3c5118e51b on hv-cinder-85221 Sep 01 14:12:53.237714 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-3fb8fcd6-3c27-4f58-a6e7-9a58cde27fee req-b68b6097-e67d-4222-9256-84f5f0e0c5c0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034043 Sep 01 14:12:53.238347 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 623/1245] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 14:12:53.244648 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-badfbd16-8be7-4735-b226-12dd375edc53 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Going to try to terminate instance {{(pid=127812) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:12:53.723111 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-badfbd16-8be7-4735-b226-12dd375edc53 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 204 len: 0 microversion: 2.1 time: 0.521174 Sep 01 14:12:53.723878 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 623/1246] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:12:53 2022] DELETE /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:12:53.743041 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-36b87f24-b7d5-45c6-a6f5-4c1ba84ee0fa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:53.743791 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-36b87f24-b7d5-45c6-a6f5-4c1ba84ee0fa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:53.750599 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36b87f24-b7d5-45c6-a6f5-4c1ba84ee0fa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:53.751429 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36b87f24-b7d5-45c6-a6f5-4c1ba84ee0fa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:53.751870 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36b87f24-b7d5-45c6-a6f5-4c1ba84ee0fa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:53.752600 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36b87f24-b7d5-45c6-a6f5-4c1ba84ee0fa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:53.753058 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36b87f24-b7d5-45c6-a6f5-4c1ba84ee0fa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:53.753522 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-36b87f24-b7d5-45c6-a6f5-4c1ba84ee0fa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:53.894888 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-36b87f24-b7d5-45c6-a6f5-4c1ba84ee0fa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:53.902727 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-36b87f24-b7d5-45c6-a6f5-4c1ba84ee0fa tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1577 microversion: 2.1 time: 0.165141 Sep 01 14:12:53.903288 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 624/1247] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:53 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:54.925626 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-da6d859e-b566-483c-92ed-cffce092e329 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:54.926368 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-da6d859e-b566-483c-92ed-cffce092e329 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:54.933045 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-da6d859e-b566-483c-92ed-cffce092e329 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:54.933533 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-da6d859e-b566-483c-92ed-cffce092e329 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:54.934011 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-da6d859e-b566-483c-92ed-cffce092e329 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:54.934715 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-da6d859e-b566-483c-92ed-cffce092e329 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:54.935263 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-da6d859e-b566-483c-92ed-cffce092e329 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:54.935785 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-da6d859e-b566-483c-92ed-cffce092e329 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:55.071173 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-da6d859e-b566-483c-92ed-cffce092e329 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:55.079288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-da6d859e-b566-483c-92ed-cffce092e329 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1577 microversion: 2.1 time: 0.158604 Sep 01 14:12:55.079885 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 624/1248] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:54 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:55.969256 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-eed8250b-cf41-498f-a455-fd44fb771c71 req-d890b3c8-f4a7-4331-8002-718dbed61e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7007a86d-dd1d-45fe-a163-9f3c5118e51b", "name": "network-vif-deleted", "tag": "b3883027-3665-4906-802f-0c55de1ef651"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:12:55.979506 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-eed8250b-cf41-498f-a455-fd44fb771c71 req-d890b3c8-f4a7-4331-8002-718dbed61e4c service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:55.980067 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-eed8250b-cf41-498f-a455-fd44fb771c71 req-d890b3c8-f4a7-4331-8002-718dbed61e4c service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:55.980515 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-eed8250b-cf41-498f-a455-fd44fb771c71 req-d890b3c8-f4a7-4331-8002-718dbed61e4c service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:55.991457 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-eed8250b-cf41-498f-a455-fd44fb771c71 req-d890b3c8-f4a7-4331-8002-718dbed61e4c service nova] Creating event network-vif-deleted:b3883027-3665-4906-802f-0c55de1ef651 for instance 7007a86d-dd1d-45fe-a163-9f3c5118e51b on hv-cinder-85221 Sep 01 14:12:55.996495 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-eed8250b-cf41-498f-a455-fd44fb771c71 req-d890b3c8-f4a7-4331-8002-718dbed61e4c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031229 Sep 01 14:12:55.997083 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 625/1249] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:12:56.100469 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-32c1e16f-9736-40c0-abea-8a51cd58cf07 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:56.101078 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-32c1e16f-9736-40c0-abea-8a51cd58cf07 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:56.107801 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32c1e16f-9736-40c0-abea-8a51cd58cf07 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:56.108288 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32c1e16f-9736-40c0-abea-8a51cd58cf07 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:56.108815 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32c1e16f-9736-40c0-abea-8a51cd58cf07 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:56.109520 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32c1e16f-9736-40c0-abea-8a51cd58cf07 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:56.110003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32c1e16f-9736-40c0-abea-8a51cd58cf07 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:56.110458 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-32c1e16f-9736-40c0-abea-8a51cd58cf07 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:56.177779 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-32c1e16f-9736-40c0-abea-8a51cd58cf07 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:56.185561 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-32c1e16f-9736-40c0-abea-8a51cd58cf07 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1392 microversion: 2.1 time: 0.088968 Sep 01 14:12:56.186108 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 625/1250] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:56 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1392 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:57.208164 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:57.208864 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:57.216233 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:57.216730 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:57.217298 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:57.218035 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:57.218494 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:57.218927 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:57.251605 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:57.252078 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:57.252510 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:57.252948 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.objects.instance [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lazy-loading 'fault' on Instance uuid 7007a86d-dd1d-45fe-a163-9f3c5118e51b {{(pid=127811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:12:57.301852 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748b8b4771ac498a88fdd98c8a4914ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9086ba5c610d4954a238d6569ec32f0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:12:57.310574 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-e5f5032a-8452-4bee-8f90-ff908ebf63a7 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 200 len: 1231 microversion: 2.1 time: 0.107433 Sep 01 14:12:57.315112 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 626/1251] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:57 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 1231 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:12:58.332419 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-bbcbad54-0be5-43bd-b7bd-efe10f5da3ce tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:58.333211 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-bbcbad54-0be5-43bd-b7bd-efe10f5da3ce tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 7007a86d-dd1d-45fe-a163-9f3c5118e51b] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:58.340286 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bbcbad54-0be5-43bd-b7bd-efe10f5da3ce tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:58.340791 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bbcbad54-0be5-43bd-b7bd-efe10f5da3ce tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:58.341220 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bbcbad54-0be5-43bd-b7bd-efe10f5da3ce tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:58.341975 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bbcbad54-0be5-43bd-b7bd-efe10f5da3ce tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:58.342425 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bbcbad54-0be5-43bd-b7bd-efe10f5da3ce tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:58.342872 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-bbcbad54-0be5-43bd-b7bd-efe10f5da3ce tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:58.360125 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-bbcbad54-0be5-43bd-b7bd-efe10f5da3ce tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] HTTP exception thrown: Instance 7007a86d-dd1d-45fe-a163-9f3c5118e51b could not be found. Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-bbcbad54-0be5-43bd-b7bd-efe10f5da3ce tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Request method failure captured: Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b HTTP/1.1 Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELwUAd9uZvipXIPvhrAl9M1gbALqYrwCACOdFsg6eEYQQ0SbUtKohFPV4qiStan4YPpxBQ8-doa6Z8WMTQdSfASO9jJuuWAQfy2y5R9s3ElypO0zXeJlLDJrQvJyMORMqWq-1O-uVzpu7bg3dGq5pnRQZTBWxtxdZQrfUPQBsAk0OX0 Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 9086ba5c610d4954a238d6569ec32f0b Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-TestVolumeBootPattern-185563680 Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:12:58.361754 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:12:58.364062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9086ba5c610d4954a238d6569ec32f0b"}]}] Sep 01 14:12:58.364062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-TestVolumeBootPattern-185563680 Sep 01 14:12:58.364062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 9086ba5c610d4954a238d6569ec32f0b Sep 01 14:12:58.364062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-TestVolumeBootPattern-185563680 Sep 01 14:12:58.364062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-TestVolumeBootPattern-185563680-project Sep 01 14:12:58.364062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:12:58.364062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:12:58.364062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 748b8b4771ac498a88fdd98c8a4914ad Sep 01 14:12:58.364062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-TestVolumeBootPattern-185563680-project Sep 01 14:12:58.364062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:12:58.364062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 7007a86d-dd1d-45fe-a163-9f3c5118e51b could not be found. Sep 01 14:12:58.364062 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '7007a86d-dd1d-45fe-a163-9f3c5118e51b'} Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7007a86d-dd1d-45fe-a163-9f3c5118e51b could not be found. Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:12:58.365112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7007a86d-dd1d-45fe-a163-9f3c5118e51b could not be found. Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7007a86d-dd1d-45fe-a163-9f3c5118e51b could not be found. Sep 01 14:12:58.366980 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.368888 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-bbcbad54-0be5-43bd-b7bd-efe10f5da3ce tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Returning 404 to user: Instance 7007a86d-dd1d-45fe-a163-9f3c5118e51b could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:12:58.368888 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-bbcbad54-0be5-43bd-b7bd-efe10f5da3ce tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b" status: 404 len: 111 microversion: 2.1 time: 0.035478 Sep 01 14:12:58.368888 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 626/1252] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:58 2022] GET /compute/v2.1/servers/7007a86d-dd1d-45fe-a163-9f3c5118e51b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:12:58.849826 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cf7c6d3b-763e-4aa3-8563-145425e84ba1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:58.850344 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-cf7c6d3b-763e-4aa3-8563-145425e84ba1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:58.857008 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf7c6d3b-763e-4aa3-8563-145425e84ba1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:58.864045 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf7c6d3b-763e-4aa3-8563-145425e84ba1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:58.864045 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf7c6d3b-763e-4aa3-8563-145425e84ba1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:58.864045 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf7c6d3b-763e-4aa3-8563-145425e84ba1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:58.864045 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf7c6d3b-763e-4aa3-8563-145425e84ba1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:58.864571 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cf7c6d3b-763e-4aa3-8563-145425e84ba1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:58.873322 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-cf7c6d3b-763e-4aa3-8563-145425e84ba1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] HTTP exception thrown: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cf7c6d3b-763e-4aa3-8563-145425e84ba1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Request method failure captured: Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: DELETE /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 HTTP/1.1 Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjELwUAd9uZvipXIPvhrAl9M1gbALqYrwCACOdFsg6eEYQQ0SbUtKohFPV4qiStan4YPpxBQ8-doa6Z8WMTQdSfASO9jJuuWAQfy2y5R9s3ElypO0zXeJlLDJrQvJyMORMqWq-1O-uVzpu7bg3dGq5pnRQZTBWxtxdZQrfUPQBsAk0OX0 Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: 9086ba5c610d4954a238d6569ec32f0b Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-TestVolumeBootPattern-185563680 Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:12:58.875249 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:12:58.876995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9086ba5c610d4954a238d6569ec32f0b"}]}] Sep 01 14:12:58.876995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-TestVolumeBootPattern-185563680 Sep 01 14:12:58.876995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: 9086ba5c610d4954a238d6569ec32f0b Sep 01 14:12:58.876995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-TestVolumeBootPattern-185563680 Sep 01 14:12:58.876995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-TestVolumeBootPattern-185563680-project Sep 01 14:12:58.876995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:12:58.876995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:12:58.876995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 748b8b4771ac498a88fdd98c8a4914ad Sep 01 14:12:58.876995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-TestVolumeBootPattern-185563680-project Sep 01 14:12:58.876995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:12:58.876995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:12:58.876995 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': '9ec24f5b-aec6-406b-bf20-dd2e3d4e8438'} Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:12:58.878587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:12:58.880229 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.882268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cf7c6d3b-763e-4aa3-8563-145425e84ba1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Returning 404 to user: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:12:58.882268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cf7c6d3b-763e-4aa3-8563-145425e84ba1 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 404 len: 111 microversion: 2.1 time: 0.030962 Sep 01 14:12:58.882268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 627/1253] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:12:58 2022] DELETE /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:12:58.886459 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-79c3575f-4056-446c-8077-0305bdd1f560 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:12:58.887068 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-79c3575f-4056-446c-8077-0305bdd1f560 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] [instance: 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:12:58.893023 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79c3575f-4056-446c-8077-0305bdd1f560 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:58.893508 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79c3575f-4056-446c-8077-0305bdd1f560 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:58.894505 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79c3575f-4056-446c-8077-0305bdd1f560 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:58.895196 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79c3575f-4056-446c-8077-0305bdd1f560 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:12:58.895657 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79c3575f-4056-446c-8077-0305bdd1f560 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:12:58.896084 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-79c3575f-4056-446c-8077-0305bdd1f560 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:12:58.909353 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.wsgi [None req-79c3575f-4056-446c-8077-0305bdd1f560 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] HTTP exception thrown: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-79c3575f-4056-446c-8077-0305bdd1f560 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Request method failure captured: Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: request: GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 HTTP/1.1 Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept: application/json Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Accept-Encoding: identity Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Connection: close Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Length: 0 Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Content-Type: application/json Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Host: 10.222.0.61 Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Openstack-System-Scope: None Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: User-Agent: python-urllib3/1.26.12 Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Auth-Token: gAAAAABjELwUAd9uZvipXIPvhrAl9M1gbALqYrwCACOdFsg6eEYQQ0SbUtKohFPV4qiStan4YPpxBQ8-doa6Z8WMTQdSfASO9jJuuWAQfy2y5R9s3ElypO0zXeJlLDJrQvJyMORMqWq-1O-uVzpu7bg3dGq5pnRQZTBWxtxdZQrfUPQBsAk0OX0 Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Id: None Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Domain-Name: None Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Identity-Status: Confirmed Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Is-Admin-Project: True Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Id: default Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Domain-Name: Default Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Id: 9086ba5c610d4954a238d6569ec32f0b Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Project-Name: tempest-TestVolumeBootPattern-185563680 Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Role: member,reader Sep 01 14:12:58.910890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Roles: member,reader Sep 01 14:12:58.912717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9086ba5c610d4954a238d6569ec32f0b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9086ba5c610d4954a238d6569ec32f0b"}]}] Sep 01 14:12:58.912717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant: tempest-TestVolumeBootPattern-185563680 Sep 01 14:12:58.912717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Id: 9086ba5c610d4954a238d6569ec32f0b Sep 01 14:12:58.912717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-Tenant-Name: tempest-TestVolumeBootPattern-185563680 Sep 01 14:12:58.912717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User: tempest-TestVolumeBootPattern-185563680-project Sep 01 14:12:58.912717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Id: default Sep 01 14:12:58.912717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Domain-Name: Default Sep 01 14:12:58.912717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Id: 748b8b4771ac498a88fdd98c8a4914ad Sep 01 14:12:58.912717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: X-User-Name: tempest-TestVolumeBootPattern-185563680-project Sep 01 14:12:58.912717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: method: > Sep 01 14:12:58.912717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: exception: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:12:58.912717 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: action_args: {'id': '9ec24f5b-aec6-406b-bf20-dd2e3d4e8438'} Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:12:58.913716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. Sep 01 14:12:58.915439 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: ERROR nova.api.openstack.wsgi Sep 01 14:12:58.916963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-79c3575f-4056-446c-8077-0305bdd1f560 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Returning 404 to user: Instance 9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 could not be found. {{(pid=127812) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:12:58.916963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-79c3575f-4056-446c-8077-0305bdd1f560 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438" status: 404 len: 111 microversion: 2.1 time: 0.029725 Sep 01 14:12:58.916963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 627/1254] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:12:58 2022] GET /compute/v2.1/servers/9ec24f5b-aec6-406b-bf20-dd2e3d4e8438 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:13:00.487500 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2724b79d-ddfd-40b5-afb4-7b1244190c57 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] Calling method '.version_select at 0x7f1afd71c3a0>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:13:00.586194 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2724b79d-ddfd-40b5-afb4-7b1244190c57 tempest-TestVolumeBootPattern-185563680 tempest-TestVolumeBootPattern-185563680-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1757307735" status: 202 len: 0 microversion: 2.1 time: 0.102787 Sep 01 14:13:00.586786 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 628/1255] 10.222.0.61 () {58 vars in 1263 bytes} [Thu Sep 1 14:13:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1757307735 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:14:08.283108 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:08.283866 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:08.288106 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-212ca6a4-514d-41c5-b53d-adb98ae30c57 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:14:08.288659 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-212ca6a4-514d-41c5-b53d-adb98ae30c57 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:08.294522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-212ca6a4-514d-41c5-b53d-adb98ae30c57 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:08.295000 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-212ca6a4-514d-41c5-b53d-adb98ae30c57 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:08.295529 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-212ca6a4-514d-41c5-b53d-adb98ae30c57 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:08.296110 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-212ca6a4-514d-41c5-b53d-adb98ae30c57 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:08.296557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-212ca6a4-514d-41c5-b53d-adb98ae30c57 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:08.296973 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-212ca6a4-514d-41c5-b53d-adb98ae30c57 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:08.319619 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-212ca6a4-514d-41c5-b53d-adb98ae30c57 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lazy-loading 'flavor' on Instance uuid bc01db73-68ab-4fc1-b642-2967c555e129 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:14:08.778712 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-212ca6a4-514d-41c5-b53d-adb98ae30c57 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "POST /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129/action" status: 202 len: 0 microversion: 2.1 time: 0.497822 Sep 01 14:14:08.779334 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 628/1256] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:14:08 2022] POST /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 14:14:08.785790 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:08.786541 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:08.790758 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-3b5cc486-83c0-42e1-9d69-f3a08e2efcd3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:08.791374 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-3b5cc486-83c0-42e1-9d69-f3a08e2efcd3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:08.798204 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b5cc486-83c0-42e1-9d69-f3a08e2efcd3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:08.798699 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b5cc486-83c0-42e1-9d69-f3a08e2efcd3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:08.799133 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b5cc486-83c0-42e1-9d69-f3a08e2efcd3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:08.799871 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b5cc486-83c0-42e1-9d69-f3a08e2efcd3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:08.800322 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b5cc486-83c0-42e1-9d69-f3a08e2efcd3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:08.800744 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-3b5cc486-83c0-42e1-9d69-f3a08e2efcd3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:08.934308 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-3b5cc486-83c0-42e1-9d69-f3a08e2efcd3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:08.943304 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-3b5cc486-83c0-42e1-9d69-f3a08e2efcd3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.159594 Sep 01 14:14:08.944049 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 629/1257] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:08 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:09.965172 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a2503ad3-9cc2-4875-bf6d-7379cb41837f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:09.965933 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a2503ad3-9cc2-4875-bf6d-7379cb41837f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:09.972749 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a2503ad3-9cc2-4875-bf6d-7379cb41837f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:09.973234 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a2503ad3-9cc2-4875-bf6d-7379cb41837f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:09.973673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a2503ad3-9cc2-4875-bf6d-7379cb41837f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:09.974424 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a2503ad3-9cc2-4875-bf6d-7379cb41837f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:09.974909 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a2503ad3-9cc2-4875-bf6d-7379cb41837f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:09.975339 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a2503ad3-9cc2-4875-bf6d-7379cb41837f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:10.112343 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a2503ad3-9cc2-4875-bf6d-7379cb41837f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:10.120391 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a2503ad3-9cc2-4875-bf6d-7379cb41837f tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.160551 Sep 01 14:14:10.120950 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 629/1258] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:09 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:11.143177 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-cefcf06f-16b4-4fec-ad33-88f202c6ca78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:11.145651 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-cefcf06f-16b4-4fec-ad33-88f202c6ca78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:11.151923 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cefcf06f-16b4-4fec-ad33-88f202c6ca78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:11.152399 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cefcf06f-16b4-4fec-ad33-88f202c6ca78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:11.152834 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cefcf06f-16b4-4fec-ad33-88f202c6ca78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:11.153521 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cefcf06f-16b4-4fec-ad33-88f202c6ca78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:11.154005 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cefcf06f-16b4-4fec-ad33-88f202c6ca78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:11.154426 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-cefcf06f-16b4-4fec-ad33-88f202c6ca78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:11.284870 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-cefcf06f-16b4-4fec-ad33-88f202c6ca78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:11.299164 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-cefcf06f-16b4-4fec-ad33-88f202c6ca78 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.160362 Sep 01 14:14:11.299795 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 630/1259] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:11 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:12.320146 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-a6de2177-68e6-4fbd-8ae0-cc2dbcd321f5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:12.320735 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-a6de2177-68e6-4fbd-8ae0-cc2dbcd321f5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:12.327174 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a6de2177-68e6-4fbd-8ae0-cc2dbcd321f5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:12.327651 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a6de2177-68e6-4fbd-8ae0-cc2dbcd321f5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:12.328089 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a6de2177-68e6-4fbd-8ae0-cc2dbcd321f5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:12.328783 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a6de2177-68e6-4fbd-8ae0-cc2dbcd321f5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:12.329237 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a6de2177-68e6-4fbd-8ae0-cc2dbcd321f5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:12.329663 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-a6de2177-68e6-4fbd-8ae0-cc2dbcd321f5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:12.457675 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-a6de2177-68e6-4fbd-8ae0-cc2dbcd321f5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:12.465487 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-a6de2177-68e6-4fbd-8ae0-cc2dbcd321f5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.149236 Sep 01 14:14:12.466090 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 630/1260] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:12 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:13.487445 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-53097c44-5e50-4604-a681-8ee15ed9f031 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:13.488041 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-53097c44-5e50-4604-a681-8ee15ed9f031 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:13.494848 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-53097c44-5e50-4604-a681-8ee15ed9f031 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:13.495326 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-53097c44-5e50-4604-a681-8ee15ed9f031 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:13.495760 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-53097c44-5e50-4604-a681-8ee15ed9f031 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:13.496446 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-53097c44-5e50-4604-a681-8ee15ed9f031 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:13.496902 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-53097c44-5e50-4604-a681-8ee15ed9f031 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:13.497315 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-53097c44-5e50-4604-a681-8ee15ed9f031 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:13.636360 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-53097c44-5e50-4604-a681-8ee15ed9f031 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:13.644447 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-53097c44-5e50-4604-a681-8ee15ed9f031 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.160789 Sep 01 14:14:13.645011 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 631/1261] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:13 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:14.668190 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-7eeb5f1b-8432-408d-91f5-17628d150ad4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:14.668779 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-7eeb5f1b-8432-408d-91f5-17628d150ad4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:14.675968 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7eeb5f1b-8432-408d-91f5-17628d150ad4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:14.676443 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7eeb5f1b-8432-408d-91f5-17628d150ad4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:14.676875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7eeb5f1b-8432-408d-91f5-17628d150ad4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:14.677617 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7eeb5f1b-8432-408d-91f5-17628d150ad4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:14.678289 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7eeb5f1b-8432-408d-91f5-17628d150ad4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:14.678797 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-7eeb5f1b-8432-408d-91f5-17628d150ad4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:14.809270 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-7eeb5f1b-8432-408d-91f5-17628d150ad4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:14.817188 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-7eeb5f1b-8432-408d-91f5-17628d150ad4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.152827 Sep 01 14:14:14.817746 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 631/1262] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:14 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:15.838349 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-2d13e927-7aa7-4f60-89f2-a18691589c7b tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:15.839025 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-2d13e927-7aa7-4f60-89f2-a18691589c7b tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:15.845597 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d13e927-7aa7-4f60-89f2-a18691589c7b tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:15.846145 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d13e927-7aa7-4f60-89f2-a18691589c7b tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:15.846584 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d13e927-7aa7-4f60-89f2-a18691589c7b tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:15.847279 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d13e927-7aa7-4f60-89f2-a18691589c7b tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:15.847770 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d13e927-7aa7-4f60-89f2-a18691589c7b tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:15.848234 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-2d13e927-7aa7-4f60-89f2-a18691589c7b tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:15.984043 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-2d13e927-7aa7-4f60-89f2-a18691589c7b tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:15.992450 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-2d13e927-7aa7-4f60-89f2-a18691589c7b tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.158082 Sep 01 14:14:15.993020 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 632/1263] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:15 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:17.014456 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-4d962bc6-560d-42f5-bf7c-cf28f43f0147 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:17.015076 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-4d962bc6-560d-42f5-bf7c-cf28f43f0147 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:17.021599 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4d962bc6-560d-42f5-bf7c-cf28f43f0147 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:17.024492 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4d962bc6-560d-42f5-bf7c-cf28f43f0147 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:17.024492 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4d962bc6-560d-42f5-bf7c-cf28f43f0147 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:17.024492 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4d962bc6-560d-42f5-bf7c-cf28f43f0147 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:17.024492 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4d962bc6-560d-42f5-bf7c-cf28f43f0147 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:17.024917 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-4d962bc6-560d-42f5-bf7c-cf28f43f0147 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:17.155805 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-4d962bc6-560d-42f5-bf7c-cf28f43f0147 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:17.164209 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-4d962bc6-560d-42f5-bf7c-cf28f43f0147 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.154473 Sep 01 14:14:17.164953 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 632/1264] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:17 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:18.185638 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-70426fb7-d86c-46a1-b18a-bc0ce0b967ac tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:18.186303 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-70426fb7-d86c-46a1-b18a-bc0ce0b967ac tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:18.193448 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-70426fb7-d86c-46a1-b18a-bc0ce0b967ac tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:18.193984 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-70426fb7-d86c-46a1-b18a-bc0ce0b967ac tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:18.194423 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-70426fb7-d86c-46a1-b18a-bc0ce0b967ac tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:18.195152 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-70426fb7-d86c-46a1-b18a-bc0ce0b967ac tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:18.195587 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-70426fb7-d86c-46a1-b18a-bc0ce0b967ac tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:18.196017 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-70426fb7-d86c-46a1-b18a-bc0ce0b967ac tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:18.327032 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-70426fb7-d86c-46a1-b18a-bc0ce0b967ac tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:18.334991 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-70426fb7-d86c-46a1-b18a-bc0ce0b967ac tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.153372 Sep 01 14:14:18.335559 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 633/1265] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:18 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:19.356792 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-427ae1ec-ea67-4123-8a0c-cf6ba92555af tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:19.357420 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-427ae1ec-ea67-4123-8a0c-cf6ba92555af tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:19.364779 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-427ae1ec-ea67-4123-8a0c-cf6ba92555af tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:19.365282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-427ae1ec-ea67-4123-8a0c-cf6ba92555af tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:19.365752 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-427ae1ec-ea67-4123-8a0c-cf6ba92555af tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:19.366518 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-427ae1ec-ea67-4123-8a0c-cf6ba92555af tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:19.367000 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-427ae1ec-ea67-4123-8a0c-cf6ba92555af tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:19.367428 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-427ae1ec-ea67-4123-8a0c-cf6ba92555af tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:19.508147 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-427ae1ec-ea67-4123-8a0c-cf6ba92555af tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:19.516055 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-427ae1ec-ea67-4123-8a0c-cf6ba92555af tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.163219 Sep 01 14:14:19.516638 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 633/1266] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:19 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:20.537026 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1f376c84-e5af-4ea9-a719-ed54f3b5d736 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:20.537613 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1f376c84-e5af-4ea9-a719-ed54f3b5d736 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:20.544174 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f376c84-e5af-4ea9-a719-ed54f3b5d736 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:20.544662 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f376c84-e5af-4ea9-a719-ed54f3b5d736 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:20.545104 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f376c84-e5af-4ea9-a719-ed54f3b5d736 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:20.545824 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f376c84-e5af-4ea9-a719-ed54f3b5d736 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:20.546282 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f376c84-e5af-4ea9-a719-ed54f3b5d736 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:20.546707 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1f376c84-e5af-4ea9-a719-ed54f3b5d736 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:20.674389 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1f376c84-e5af-4ea9-a719-ed54f3b5d736 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:20.682807 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1f376c84-e5af-4ea9-a719-ed54f3b5d736 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.150154 Sep 01 14:14:20.683368 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 634/1267] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:20 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:21.704091 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-c45412b8-cf26-4bfd-9ace-a78edc59aa88 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:21.704706 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-c45412b8-cf26-4bfd-9ace-a78edc59aa88 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:21.711578 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c45412b8-cf26-4bfd-9ace-a78edc59aa88 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:21.712063 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c45412b8-cf26-4bfd-9ace-a78edc59aa88 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:21.712498 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c45412b8-cf26-4bfd-9ace-a78edc59aa88 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:21.713188 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c45412b8-cf26-4bfd-9ace-a78edc59aa88 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:21.713638 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c45412b8-cf26-4bfd-9ace-a78edc59aa88 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:21.714095 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-c45412b8-cf26-4bfd-9ace-a78edc59aa88 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:21.851166 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-c45412b8-cf26-4bfd-9ace-a78edc59aa88 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:21.859140 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-c45412b8-cf26-4bfd-9ace-a78edc59aa88 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.158904 Sep 01 14:14:21.859734 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 634/1268] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:21 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:22.879632 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-9ff2ba85-5125-48bc-8963-69cdbf5862a7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:22.880248 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-9ff2ba85-5125-48bc-8963-69cdbf5862a7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:22.886689 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9ff2ba85-5125-48bc-8963-69cdbf5862a7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:22.887160 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9ff2ba85-5125-48bc-8963-69cdbf5862a7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:22.887595 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9ff2ba85-5125-48bc-8963-69cdbf5862a7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:22.888269 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9ff2ba85-5125-48bc-8963-69cdbf5862a7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:22.888712 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9ff2ba85-5125-48bc-8963-69cdbf5862a7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:22.889127 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-9ff2ba85-5125-48bc-8963-69cdbf5862a7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:23.025120 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-9ff2ba85-5125-48bc-8963-69cdbf5862a7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:23.032313 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-9ff2ba85-5125-48bc-8963-69cdbf5862a7 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1568 microversion: 2.1 time: 0.156501 Sep 01 14:14:23.032870 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 635/1269] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:22 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:23.053539 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-19859f6e-7e59-4b5f-b1e5-d88a3575e36c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:14:23.065083 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-19859f6e-7e59-4b5f-b1e5-d88a3575e36c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:23.065083 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-19859f6e-7e59-4b5f-b1e5-d88a3575e36c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:23.065083 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-19859f6e-7e59-4b5f-b1e5-d88a3575e36c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:23.065083 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-19859f6e-7e59-4b5f-b1e5-d88a3575e36c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:23.065517 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-19859f6e-7e59-4b5f-b1e5-d88a3575e36c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:23.065517 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-19859f6e-7e59-4b5f-b1e5-d88a3575e36c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:23.065517 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-19859f6e-7e59-4b5f-b1e5-d88a3575e36c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:23.092053 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-19859f6e-7e59-4b5f-b1e5-d88a3575e36c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127812) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 01 14:14:23.613011 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-19859f6e-7e59-4b5f-b1e5-d88a3575e36c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "POST /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129/action" status: 202 len: 0 microversion: 2.1 time: 0.563954 Sep 01 14:14:23.622922 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 635/1270] 10.222.0.61 () {60 vars in 1278 bytes} [Thu Sep 1 14:14:23 2022] POST /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 14:14:23.623098 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-624d6f1a-a6a8-489f-af54-049eda3c7949 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:23.623098 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-624d6f1a-a6a8-489f-af54-049eda3c7949 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:23.628785 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-624d6f1a-a6a8-489f-af54-049eda3c7949 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:23.629268 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-624d6f1a-a6a8-489f-af54-049eda3c7949 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:23.629704 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-624d6f1a-a6a8-489f-af54-049eda3c7949 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:23.630433 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-624d6f1a-a6a8-489f-af54-049eda3c7949 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:23.630890 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-624d6f1a-a6a8-489f-af54-049eda3c7949 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:23.631316 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-624d6f1a-a6a8-489f-af54-049eda3c7949 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:23.767250 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-624d6f1a-a6a8-489f-af54-049eda3c7949 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:23.776085 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-624d6f1a-a6a8-489f-af54-049eda3c7949 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1516 microversion: 2.1 time: 0.158186 Sep 01 14:14:23.776658 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 636/1271] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:23 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:24.797419 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-90ee6099-5739-43d7-8ccd-8ef4a22e3efa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:24.798065 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-90ee6099-5739-43d7-8ccd-8ef4a22e3efa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:24.804877 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90ee6099-5739-43d7-8ccd-8ef4a22e3efa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:24.805343 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90ee6099-5739-43d7-8ccd-8ef4a22e3efa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:24.805804 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90ee6099-5739-43d7-8ccd-8ef4a22e3efa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:24.806540 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90ee6099-5739-43d7-8ccd-8ef4a22e3efa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:24.806996 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90ee6099-5739-43d7-8ccd-8ef4a22e3efa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:24.807424 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-90ee6099-5739-43d7-8ccd-8ef4a22e3efa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:24.939011 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-90ee6099-5739-43d7-8ccd-8ef4a22e3efa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:24.947405 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-90ee6099-5739-43d7-8ccd-8ef4a22e3efa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1516 microversion: 2.1 time: 0.154653 Sep 01 14:14:24.947962 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 636/1272] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:24 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:25.344761 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-12a5ac99-9192-420d-b94c-1562668a3163 req-e8cb0217-92c6-4702-adb6-181ebc002bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc01db73-68ab-4fc1-b642-2967c555e129", "name": "network-vif-unplugged", "status": "completed", "tag": "3eee6459-74c7-445e-9787-dc0ed094ff8f"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:14:25.355318 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 14:14:25.355318 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Thu Sep 1 14:14:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.61) !!! Sep 01 14:14:25.358168 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-12a5ac99-9192-420d-b94c-1562668a3163 req-e8cb0217-92c6-4702-adb6-181ebc002bbc service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:25.358652 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-12a5ac99-9192-420d-b94c-1562668a3163 req-e8cb0217-92c6-4702-adb6-181ebc002bbc service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:25.359085 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-12a5ac99-9192-420d-b94c-1562668a3163 req-e8cb0217-92c6-4702-adb6-181ebc002bbc service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:25.370951 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.compute.server_external_events [req-12a5ac99-9192-420d-b94c-1562668a3163 req-e8cb0217-92c6-4702-adb6-181ebc002bbc service nova] Unable to find a host for instance bc01db73-68ab-4fc1-b642-2967c555e129. Dropping event network-vif-unplugged {{(pid=127811) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 01 14:14:25.371832 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-12a5ac99-9192-420d-b94c-1562668a3163 req-e8cb0217-92c6-4702-adb6-181ebc002bbc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030905 Sep 01 14:14:25.372405 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 637/1273] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 14:14:25.968413 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-f3334823-bda7-47f6-b7f7-cd690678adb5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:25.969050 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-f3334823-bda7-47f6-b7f7-cd690678adb5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:25.976378 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f3334823-bda7-47f6-b7f7-cd690678adb5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:25.976867 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f3334823-bda7-47f6-b7f7-cd690678adb5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:25.977314 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f3334823-bda7-47f6-b7f7-cd690678adb5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:25.978076 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f3334823-bda7-47f6-b7f7-cd690678adb5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:25.978534 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f3334823-bda7-47f6-b7f7-cd690678adb5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:25.978984 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-f3334823-bda7-47f6-b7f7-cd690678adb5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:26.111323 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-f3334823-bda7-47f6-b7f7-cd690678adb5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:26.119152 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-f3334823-bda7-47f6-b7f7-cd690678adb5 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1518 microversion: 2.1 time: 0.154712 Sep 01 14:14:26.119729 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 637/1274] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:25 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:27.142836 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-d1a5e748-3163-4a5c-8ddd-fc6950524125 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:27.143455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-d1a5e748-3163-4a5c-8ddd-fc6950524125 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:27.150166 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1a5e748-3163-4a5c-8ddd-fc6950524125 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:27.150707 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1a5e748-3163-4a5c-8ddd-fc6950524125 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:27.151149 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1a5e748-3163-4a5c-8ddd-fc6950524125 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:27.152062 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1a5e748-3163-4a5c-8ddd-fc6950524125 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:27.152794 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1a5e748-3163-4a5c-8ddd-fc6950524125 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:27.152930 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-d1a5e748-3163-4a5c-8ddd-fc6950524125 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:27.294333 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-d1a5e748-3163-4a5c-8ddd-fc6950524125 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:27.302377 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-d1a5e748-3163-4a5c-8ddd-fc6950524125 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1574 microversion: 2.1 time: 0.163489 Sep 01 14:14:27.303048 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 638/1275] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:27 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:28.323685 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-fa45e8aa-7d76-4fb1-9c51-928fe27374cd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:28.324326 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-fa45e8aa-7d76-4fb1-9c51-928fe27374cd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:28.326920 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 14:14:28.327051 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: Thu Sep 1 14:14:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 (ip 10.222.0.61) !!! Sep 01 14:14:28.332996 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fa45e8aa-7d76-4fb1-9c51-928fe27374cd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:28.333488 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fa45e8aa-7d76-4fb1-9c51-928fe27374cd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:28.334083 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fa45e8aa-7d76-4fb1-9c51-928fe27374cd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:28.334812 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fa45e8aa-7d76-4fb1-9c51-928fe27374cd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:28.335287 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fa45e8aa-7d76-4fb1-9c51-928fe27374cd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:28.335718 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-fa45e8aa-7d76-4fb1-9c51-928fe27374cd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:28.473602 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-fa45e8aa-7d76-4fb1-9c51-928fe27374cd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:28.481631 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-fa45e8aa-7d76-4fb1-9c51-928fe27374cd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1574 microversion: 2.1 time: 0.161971 Sep 01 14:14:28.482279 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 638/1276] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:28 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:29.503397 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-7ccd24bd-bfe6-4aab-bb40-787390a683dd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:29.504090 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-7ccd24bd-bfe6-4aab-bb40-787390a683dd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:29.511514 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7ccd24bd-bfe6-4aab-bb40-787390a683dd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:29.512010 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7ccd24bd-bfe6-4aab-bb40-787390a683dd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:29.512455 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7ccd24bd-bfe6-4aab-bb40-787390a683dd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:29.513159 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7ccd24bd-bfe6-4aab-bb40-787390a683dd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:29.513616 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7ccd24bd-bfe6-4aab-bb40-787390a683dd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:29.514091 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-7ccd24bd-bfe6-4aab-bb40-787390a683dd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:29.648401 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-7ccd24bd-bfe6-4aab-bb40-787390a683dd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:29.656144 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-7ccd24bd-bfe6-4aab-bb40-787390a683dd tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1574 microversion: 2.1 time: 0.156692 Sep 01 14:14:29.656706 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 639/1277] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:29 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:30.676677 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-5adfe290-aeb8-4b4f-a138-8ca540beb0aa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:30.677290 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-5adfe290-aeb8-4b4f-a138-8ca540beb0aa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:30.684098 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5adfe290-aeb8-4b4f-a138-8ca540beb0aa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:30.684581 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5adfe290-aeb8-4b4f-a138-8ca540beb0aa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:30.685012 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5adfe290-aeb8-4b4f-a138-8ca540beb0aa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:30.685932 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5adfe290-aeb8-4b4f-a138-8ca540beb0aa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:30.686381 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5adfe290-aeb8-4b4f-a138-8ca540beb0aa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:30.686828 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-5adfe290-aeb8-4b4f-a138-8ca540beb0aa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:30.820003 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-5adfe290-aeb8-4b4f-a138-8ca540beb0aa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:30.827722 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-5adfe290-aeb8-4b4f-a138-8ca540beb0aa tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1574 microversion: 2.1 time: 0.155080 Sep 01 14:14:30.828289 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 639/1278] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:30 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:31.848856 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-93a33875-2b5d-4489-ae63-2354349d4ec4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:31.849531 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-93a33875-2b5d-4489-ae63-2354349d4ec4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:31.856255 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-93a33875-2b5d-4489-ae63-2354349d4ec4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:31.856745 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-93a33875-2b5d-4489-ae63-2354349d4ec4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:31.857193 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-93a33875-2b5d-4489-ae63-2354349d4ec4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:31.857920 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-93a33875-2b5d-4489-ae63-2354349d4ec4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:31.858388 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-93a33875-2b5d-4489-ae63-2354349d4ec4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:31.858816 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-93a33875-2b5d-4489-ae63-2354349d4ec4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:31.991163 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-93a33875-2b5d-4489-ae63-2354349d4ec4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:31.998942 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-93a33875-2b5d-4489-ae63-2354349d4ec4 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1574 microversion: 2.1 time: 0.154165 Sep 01 14:14:31.999496 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 640/1279] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:31 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:33.019993 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-192cd87a-3889-4d05-8997-a906f9465af3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:33.020599 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-192cd87a-3889-4d05-8997-a906f9465af3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:33.027041 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-192cd87a-3889-4d05-8997-a906f9465af3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:33.027524 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-192cd87a-3889-4d05-8997-a906f9465af3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:33.027961 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-192cd87a-3889-4d05-8997-a906f9465af3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:33.028644 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-192cd87a-3889-4d05-8997-a906f9465af3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:33.029093 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-192cd87a-3889-4d05-8997-a906f9465af3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:33.029517 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-192cd87a-3889-4d05-8997-a906f9465af3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:33.167568 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-192cd87a-3889-4d05-8997-a906f9465af3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:33.175151 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-192cd87a-3889-4d05-8997-a906f9465af3 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1574 microversion: 2.1 time: 0.159015 Sep 01 14:14:33.175714 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 640/1280] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:33 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:34.197286 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-db3fc824-a010-4ce3-a910-81ae5c07a1e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:34.197968 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-db3fc824-a010-4ce3-a910-81ae5c07a1e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:34.204425 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-db3fc824-a010-4ce3-a910-81ae5c07a1e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:34.208394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-db3fc824-a010-4ce3-a910-81ae5c07a1e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:34.208394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-db3fc824-a010-4ce3-a910-81ae5c07a1e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:34.208394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-db3fc824-a010-4ce3-a910-81ae5c07a1e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:34.208394 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-db3fc824-a010-4ce3-a910-81ae5c07a1e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:34.208847 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-db3fc824-a010-4ce3-a910-81ae5c07a1e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:34.340829 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-db3fc824-a010-4ce3-a910-81ae5c07a1e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:34.349309 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-db3fc824-a010-4ce3-a910-81ae5c07a1e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1574 microversion: 2.1 time: 0.155984 Sep 01 14:14:34.350028 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 641/1281] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:34 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:35.370915 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-2dc8fe8b-6472-4424-84f1-03d6a1b5e40e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:35.371522 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-2dc8fe8b-6472-4424-84f1-03d6a1b5e40e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:35.377917 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2dc8fe8b-6472-4424-84f1-03d6a1b5e40e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:35.378404 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2dc8fe8b-6472-4424-84f1-03d6a1b5e40e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:35.378839 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2dc8fe8b-6472-4424-84f1-03d6a1b5e40e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:35.380282 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2dc8fe8b-6472-4424-84f1-03d6a1b5e40e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:35.380743 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2dc8fe8b-6472-4424-84f1-03d6a1b5e40e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:35.381339 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-2dc8fe8b-6472-4424-84f1-03d6a1b5e40e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:35.402313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:35.522557 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-2dc8fe8b-6472-4424-84f1-03d6a1b5e40e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:35.530433 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-2dc8fe8b-6472-4424-84f1-03d6a1b5e40e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1574 microversion: 2.1 time: 0.163574 Sep 01 14:14:35.531070 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 641/1282] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:35 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:36.551414 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-ce581aa7-47b9-4462-8387-2b7da69aaa13 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:36.552011 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-ce581aa7-47b9-4462-8387-2b7da69aaa13 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:36.559040 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce581aa7-47b9-4462-8387-2b7da69aaa13 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:36.559521 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce581aa7-47b9-4462-8387-2b7da69aaa13 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:36.559960 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce581aa7-47b9-4462-8387-2b7da69aaa13 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:36.560645 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce581aa7-47b9-4462-8387-2b7da69aaa13 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:36.561097 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce581aa7-47b9-4462-8387-2b7da69aaa13 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:36.561520 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-ce581aa7-47b9-4462-8387-2b7da69aaa13 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:36.699911 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-ce581aa7-47b9-4462-8387-2b7da69aaa13 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:36.707791 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-ce581aa7-47b9-4462-8387-2b7da69aaa13 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1574 microversion: 2.1 time: 0.160219 Sep 01 14:14:36.708389 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 642/1283] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:36 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:37.502228 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-bfe549de-5cb6-460a-a675-0f40a58396b6 req-2bdd9954-692b-4ff4-a2a8-43145a1e0819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc01db73-68ab-4fc1-b642-2967c555e129", "name": "network-vif-plugged", "status": "completed", "tag": "3eee6459-74c7-445e-9787-dc0ed094ff8f"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:14:37.513365 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-bfe549de-5cb6-460a-a675-0f40a58396b6 req-2bdd9954-692b-4ff4-a2a8-43145a1e0819 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:37.513914 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-bfe549de-5cb6-460a-a675-0f40a58396b6 req-2bdd9954-692b-4ff4-a2a8-43145a1e0819 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:37.530010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-bfe549de-5cb6-460a-a675-0f40a58396b6 req-2bdd9954-692b-4ff4-a2a8-43145a1e0819 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:37.530010 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-bfe549de-5cb6-460a-a675-0f40a58396b6 req-2bdd9954-692b-4ff4-a2a8-43145a1e0819 service nova] Creating event network-vif-plugged:3eee6459-74c7-445e-9787-dc0ed094ff8f for instance bc01db73-68ab-4fc1-b642-2967c555e129 on hv-cinder-85221 Sep 01 14:14:37.531431 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-bfe549de-5cb6-460a-a675-0f40a58396b6 req-2bdd9954-692b-4ff4-a2a8-43145a1e0819 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033343 Sep 01 14:14:37.532023 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 642/1284] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:14:37.731508 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-1ae5c575-11f1-4dc6-890e-ebc779c058e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:37.741757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-1ae5c575-11f1-4dc6-890e-ebc779c058e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:37.741757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ae5c575-11f1-4dc6-890e-ebc779c058e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:37.741757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ae5c575-11f1-4dc6-890e-ebc779c058e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:37.741757 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ae5c575-11f1-4dc6-890e-ebc779c058e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:37.742251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ae5c575-11f1-4dc6-890e-ebc779c058e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:37.742251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ae5c575-11f1-4dc6-890e-ebc779c058e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:37.742251 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-1ae5c575-11f1-4dc6-890e-ebc779c058e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:37.883858 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-1ae5c575-11f1-4dc6-890e-ebc779c058e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:37.890204 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-1ae5c575-11f1-4dc6-890e-ebc779c058e0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1574 microversion: 2.1 time: 0.162660 Sep 01 14:14:37.890780 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 643/1285] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:37 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:38.912076 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d07ce68e-5d07-4192-8113-51d03f66ef3c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:38.912673 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d07ce68e-5d07-4192-8113-51d03f66ef3c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:38.914607 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:14:38.919392 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d07ce68e-5d07-4192-8113-51d03f66ef3c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:38.919863 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d07ce68e-5d07-4192-8113-51d03f66ef3c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:38.920296 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d07ce68e-5d07-4192-8113-51d03f66ef3c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:38.920976 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d07ce68e-5d07-4192-8113-51d03f66ef3c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:38.921426 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d07ce68e-5d07-4192-8113-51d03f66ef3c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:38.921875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d07ce68e-5d07-4192-8113-51d03f66ef3c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:39.052476 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d07ce68e-5d07-4192-8113-51d03f66ef3c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:39.060191 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d07ce68e-5d07-4192-8113-51d03f66ef3c tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1574 microversion: 2.1 time: 0.152946 Sep 01 14:14:39.060843 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 643/1286] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:38 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:14:40.081696 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-092be4a3-49d6-43db-9f80-9406ee7a04f0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:14:40.082380 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-092be4a3-49d6-43db-9f80-9406ee7a04f0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:14:40.089042 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-092be4a3-49d6-43db-9f80-9406ee7a04f0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:40.092075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-092be4a3-49d6-43db-9f80-9406ee7a04f0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:40.092075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-092be4a3-49d6-43db-9f80-9406ee7a04f0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:40.092075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-092be4a3-49d6-43db-9f80-9406ee7a04f0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:14:40.092075 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-092be4a3-49d6-43db-9f80-9406ee7a04f0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:14:40.092491 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-092be4a3-49d6-43db-9f80-9406ee7a04f0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:14:40.227209 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-092be4a3-49d6-43db-9f80-9406ee7a04f0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:14:40.235122 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-092be4a3-49d6-43db-9f80-9406ee7a04f0 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1561 microversion: 2.1 time: 0.157318 Sep 01 14:14:40.235691 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 644/1287] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:14:40 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:15:54.320337 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_api:SELECT=1 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:54.322346 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG dbcounter [-] [127812] Writing DB stats nova_cell1:SELECT=10 {{(pid=127812) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:54.323223 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_api:SELECT=32 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:54.324262 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG dbcounter [-] [127811] Writing DB stats nova_cell1:SELECT=92 {{(pid=127811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 14:15:54.326901 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-31138cfa-b5c7-4b70-97b6-14584b16968e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:54.327688 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-31138cfa-b5c7-4b70-97b6-14584b16968e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:54.328997 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [req-74a0ecd3-2216-43fd-a25b-8ccd71b42b8c req-92983877-b9a9-49b5-9ca0-d856ff86f11d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc01db73-68ab-4fc1-b642-2967c555e129", "tag": "3eee6459-74c7-445e-9787-dc0ed094ff8f"}]} {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:15:54.333313 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31138cfa-b5c7-4b70-97b6-14584b16968e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:54.333992 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31138cfa-b5c7-4b70-97b6-14584b16968e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:54.334445 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31138cfa-b5c7-4b70-97b6-14584b16968e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:54.335153 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31138cfa-b5c7-4b70-97b6-14584b16968e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:54.335611 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31138cfa-b5c7-4b70-97b6-14584b16968e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:54.336040 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-31138cfa-b5c7-4b70-97b6-14584b16968e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:54.339370 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-74a0ecd3-2216-43fd-a25b-8ccd71b42b8c req-92983877-b9a9-49b5-9ca0-d856ff86f11d service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:54.339544 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-74a0ecd3-2216-43fd-a25b-8ccd71b42b8c req-92983877-b9a9-49b5-9ca0-d856ff86f11d service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:54.341173 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [req-74a0ecd3-2216-43fd-a25b-8ccd71b42b8c req-92983877-b9a9-49b5-9ca0-d856ff86f11d service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:54.352050 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.compute.server_external_events [req-74a0ecd3-2216-43fd-a25b-8ccd71b42b8c req-92983877-b9a9-49b5-9ca0-d856ff86f11d service nova] Creating event network-changed:3eee6459-74c7-445e-9787-dc0ed094ff8f for instance bc01db73-68ab-4fc1-b642-2967c555e129 on hv-cinder-85221 Sep 01 14:15:54.355639 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR oslo.messaging._drivers.impl_rabbit [req-74a0ecd3-2216-43fd-a25b-8ccd71b42b8c req-92983877-b9a9-49b5-9ca0-d856ff86f11d service nova] [e482c969-44a8-49e7-8662-c480b16906da] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 14:15:54.361491 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-31138cfa-b5c7-4b70-97b6-14584b16968e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Going to try to terminate instance {{(pid=127812) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 14:15:54.668745 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-31138cfa-b5c7-4b70-97b6-14584b16968e tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 204 len: 0 microversion: 2.1 time: 0.349744 Sep 01 14:15:54.669347 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 644/1288] 10.222.0.61 () {58 vars in 1239 bytes} [Thu Sep 1 14:15:54 2022] DELETE /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 14:15:54.677890 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-1c04ffcc-56d3-4b3d-949b-d6f262a8dc72 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:54.678606 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-1c04ffcc-56d3-4b3d-949b-d6f262a8dc72 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:54.685187 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c04ffcc-56d3-4b3d-949b-d6f262a8dc72 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:54.685668 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c04ffcc-56d3-4b3d-949b-d6f262a8dc72 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:54.686140 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c04ffcc-56d3-4b3d-949b-d6f262a8dc72 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:54.686838 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c04ffcc-56d3-4b3d-949b-d6f262a8dc72 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:54.687293 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c04ffcc-56d3-4b3d-949b-d6f262a8dc72 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:54.687716 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-1c04ffcc-56d3-4b3d-949b-d6f262a8dc72 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:54.889907 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-1c04ffcc-56d3-4b3d-949b-d6f262a8dc72 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:54.898462 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-1c04ffcc-56d3-4b3d-949b-d6f262a8dc72 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.224796 Sep 01 14:15:54.899039 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 645/1289] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:54 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 14:15:55.362970 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO oslo.messaging._drivers.impl_rabbit [req-74a0ecd3-2216-43fd-a25b-8ccd71b42b8c req-92983877-b9a9-49b5-9ca0-d856ff86f11d service nova] [e482c969-44a8-49e7-8662-c480b16906da] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 38120. Sep 01 14:15:55.366700 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [req-74a0ecd3-2216-43fd-a25b-8ccd71b42b8c req-92983877-b9a9-49b5-9ca0-d856ff86f11d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.045897 Sep 01 14:15:55.367305 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 645/1290] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:15:55.921505 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-dc714417-3150-457c-b778-75e96f4aa312 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:55.922284 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-dc714417-3150-457c-b778-75e96f4aa312 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:55.928940 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc714417-3150-457c-b778-75e96f4aa312 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:55.929417 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc714417-3150-457c-b778-75e96f4aa312 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:55.929875 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc714417-3150-457c-b778-75e96f4aa312 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:55.930607 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc714417-3150-457c-b778-75e96f4aa312 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:55.931596 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc714417-3150-457c-b778-75e96f4aa312 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:55.932019 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-dc714417-3150-457c-b778-75e96f4aa312 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:56.064503 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-dc714417-3150-457c-b778-75e96f4aa312 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:56.072186 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-dc714417-3150-457c-b778-75e96f4aa312 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1567 microversion: 2.1 time: 0.154817 Sep 01 14:15:56.072764 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 646/1291] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:55 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:15:57.098004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-4cb4c5bf-0b5e-4bf7-875a-dfd18f36ef75 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:57.098004 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-4cb4c5bf-0b5e-4bf7-875a-dfd18f36ef75 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:57.100593 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [req-09d1d8ae-5db3-4f12-8849-d824fb3fedc5 req-0ff5a0ca-bae7-4cae-a04d-c892e4654c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc01db73-68ab-4fc1-b642-2967c555e129", "name": "network-vif-deleted", "tag": "3eee6459-74c7-445e-9787-dc0ed094ff8f"}]} {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 14:15:57.103936 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4cb4c5bf-0b5e-4bf7-875a-dfd18f36ef75 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:57.104543 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4cb4c5bf-0b5e-4bf7-875a-dfd18f36ef75 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:57.105412 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4cb4c5bf-0b5e-4bf7-875a-dfd18f36ef75 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:57.106352 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4cb4c5bf-0b5e-4bf7-875a-dfd18f36ef75 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:57.107019 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4cb4c5bf-0b5e-4bf7-875a-dfd18f36ef75 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:57.107609 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-4cb4c5bf-0b5e-4bf7-875a-dfd18f36ef75 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:57.110766 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-09d1d8ae-5db3-4f12-8849-d824fb3fedc5 req-0ff5a0ca-bae7-4cae-a04d-c892e4654c82 service nova] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:57.111269 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-09d1d8ae-5db3-4f12-8849-d824fb3fedc5 req-0ff5a0ca-bae7-4cae-a04d-c892e4654c82 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:57.111705 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [req-09d1d8ae-5db3-4f12-8849-d824fb3fedc5 req-0ff5a0ca-bae7-4cae-a04d-c892e4654c82 service nova] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:57.126028 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.compute.server_external_events [req-09d1d8ae-5db3-4f12-8849-d824fb3fedc5 req-0ff5a0ca-bae7-4cae-a04d-c892e4654c82 service nova] Creating event network-vif-deleted:3eee6459-74c7-445e-9787-dc0ed094ff8f for instance bc01db73-68ab-4fc1-b642-2967c555e129 on hv-cinder-85221 Sep 01 14:15:57.134649 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [req-09d1d8ae-5db3-4f12-8849-d824fb3fedc5 req-0ff5a0ca-bae7-4cae-a04d-c892e4654c82 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040516 Sep 01 14:15:57.134649 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 647/1292] 10.222.0.61 () {64 vars in 1317 bytes} [Thu Sep 1 14:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 14:15:57.227989 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.policy [None req-4cb4c5bf-0b5e-4bf7-875a-dfd18f36ef75 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127811) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:57.236021 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-4cb4c5bf-0b5e-4bf7-875a-dfd18f36ef75 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1382 microversion: 2.1 time: 0.145495 Sep 01 14:15:57.236714 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 646/1293] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:57 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1382 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:15:58.258112 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:58.259315 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.compute.api [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127812) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:58.265307 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:58.265839 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:58.266271 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:58.266954 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:58.267397 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:58.267817 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:58.298900 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:58.299371 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:58.299802 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG oslo_concurrency.lockutils [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127812) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:58.302122 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.objects.instance [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lazy-loading 'fault' on Instance uuid bc01db73-68ab-4fc1-b642-2967c555e129 {{(pid=127812) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 14:15:58.343707 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.policy [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b605f7c7e2e44ccaf652fabbbf4080a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb745d3f3bcb44ae9fe9cf80ce054456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127812) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 14:15:58.353015 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-d99fc217-f443-455b-a7ac-2d5596fe99c9 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 200 len: 1224 microversion: 2.1 time: 0.099835 Sep 01 14:15:58.353647 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 648/1294] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:58 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 14:15:59.373574 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-05635c19-4ac6-4245-b873-9cec105e5656 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '>' {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:59.374798 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.compute.api [None req-05635c19-4ac6-4245-b873-9cec105e5656 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] [instance: bc01db73-68ab-4fc1-b642-2967c555e129] Fetching instance by UUID {{(pid=127811) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 14:15:59.381350 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05635c19-4ac6-4245-b873-9cec105e5656 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:59.381781 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05635c19-4ac6-4245-b873-9cec105e5656 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:59.382220 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05635c19-4ac6-4245-b873-9cec105e5656 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:59.383154 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05635c19-4ac6-4245-b873-9cec105e5656 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Acquiring lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 14:15:59.383605 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05635c19-4ac6-4245-b873-9cec105e5656 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 14:15:59.384022 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG oslo_concurrency.lockutils [None req-05635c19-4ac6-4245-b873-9cec105e5656 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Lock "8be996a3-c3dc-448b-9d29-95d2c5ed6464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 14:15:59.399667 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.wsgi [None req-05635c19-4ac6-4245-b873-9cec105e5656 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] HTTP exception thrown: Instance bc01db73-68ab-4fc1-b642-2967c555e129 could not be found. Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-05635c19-4ac6-4245-b873-9cec105e5656 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Request method failure captured: Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: request: GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 HTTP/1.1 Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept: application/json Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Accept-Encoding: identity Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Connection: close Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Length: 0 Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Content-Type: application/json Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Host: 10.222.0.61 Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: Openstack-System-Scope: None Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: User-Agent: python-urllib3/1.26.12 Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Auth-Token: gAAAAABjEL2GfexXJSi_6E5IbbrYLRPfSIK9a4Bm7xR1DQwUTok_R6ThqVBM29kX-mvWuraL895vDdvFMNwkrKa8XBY20ZP4d418ubZ2QJfp8XIox_9Je8RgTlMcD7ODPSJKtz4c1GIwWkGfe1cp7B3qUgE31Pg9FjekJEEODaYDaG2SAChmqCA Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Id: None Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Domain-Name: None Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Identity-Status: Confirmed Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Is-Admin-Project: True Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Id: default Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Domain-Name: Default Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Id: fb745d3f3bcb44ae9fe9cf80ce054456 Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Project-Name: tempest-TestShelveInstance-1694854393 Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Role: member,reader Sep 01 14:15:59.401330 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Roles: member,reader Sep 01 14:15:59.403346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fb745d3f3bcb44ae9fe9cf80ce054456"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fb745d3f3bcb44ae9fe9cf80ce054456"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fb745d3f3bcb44ae9fe9cf80ce054456"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fb745d3f3bcb44ae9fe9cf80ce054456"}]}] Sep 01 14:15:59.403346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant: tempest-TestShelveInstance-1694854393 Sep 01 14:15:59.403346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Id: fb745d3f3bcb44ae9fe9cf80ce054456 Sep 01 14:15:59.403346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-Tenant-Name: tempest-TestShelveInstance-1694854393 Sep 01 14:15:59.403346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User: tempest-TestShelveInstance-1694854393-project Sep 01 14:15:59.403346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Id: default Sep 01 14:15:59.403346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Domain-Name: Default Sep 01 14:15:59.403346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Id: 3b605f7c7e2e44ccaf652fabbbf4080a Sep 01 14:15:59.403346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: X-User-Name: tempest-TestShelveInstance-1694854393-project Sep 01 14:15:59.403346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: method: > Sep 01 14:15:59.403346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: exception: Instance bc01db73-68ab-4fc1-b642-2967c555e129 could not be found. Sep 01 14:15:59.403346 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: action_args: {'id': 'bc01db73-68ab-4fc1-b642-2967c555e129'} Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: {{(pid=127811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc01db73-68ab-4fc1-b642-2967c555e129 could not be found. Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 14:15:59.404561 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc01db73-68ab-4fc1-b642-2967c555e129 could not be found. Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc01db73-68ab-4fc1-b642-2967c555e129 could not be found. Sep 01 14:15:59.406461 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: ERROR nova.api.openstack.wsgi Sep 01 14:15:59.407988 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: DEBUG nova.api.openstack.wsgi [None req-05635c19-4ac6-4245-b873-9cec105e5656 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Returning 404 to user: Instance bc01db73-68ab-4fc1-b642-2967c555e129 could not be found. {{(pid=127811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 14:15:59.407988 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: INFO nova.api.openstack.requestlog [None req-05635c19-4ac6-4245-b873-9cec105e5656 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129" status: 404 len: 111 microversion: 2.1 time: 0.033106 Sep 01 14:15:59.407988 dv-cinder-852210-7-iscsi devstack@n-api.service[127811]: [pid: 127811|app: 0|req: 647/1295] 10.222.0.61 () {58 vars in 1236 bytes} [Thu Sep 1 14:15:59 2022] GET /compute/v2.1/servers/bc01db73-68ab-4fc1-b642-2967c555e129 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 14:15:59.644963 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: DEBUG nova.api.openstack.wsgi [None req-98b47833-163c-416a-8e1a-159fe921c4f8 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] Calling method '.version_select at 0x7f1afd62aa60>' {{(pid=127812) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 14:15:59.800916 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: INFO nova.api.openstack.requestlog [None req-98b47833-163c-416a-8e1a-159fe921c4f8 tempest-TestShelveInstance-1694854393 tempest-TestShelveInstance-1694854393-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1625002278" status: 202 len: 0 microversion: 2.1 time: 0.159845 Sep 01 14:15:59.801501 dv-cinder-852210-7-iscsi devstack@n-api.service[127812]: [pid: 127812|app: 0|req: 649/1296] 10.222.0.61 () {58 vars in 1254 bytes} [Thu Sep 1 14:15:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1625002278 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)